Nov 14 14:28:58 user nova-compute[75292]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75292) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 14:28:58 user nova-compute[75292]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75292) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 14:28:58 user nova-compute[75292]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75292) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 14:28:58 user nova-compute[75292]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 14:28:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:28:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.017s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:28:58 user nova-compute[75292]: INFO nova.virt.driver [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 14:28:59 user nova-compute[75292]: INFO nova.compute.provider_config [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Acquiring lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Acquired lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Releasing lock "singleton_lock" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Full set of CONF: {{(pid=75292) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ******************************************************************************** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Configuration options gathered from: {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ================================================================================ {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] allow_resize_to_same_host      = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] arq_binding_timeout            = 300 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] backdoor_port                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] backdoor_socket                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] block_device_allocate_retries  = 300 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] block_device_allocate_retries_interval = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cert                           = self.pem {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute_monitors               = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] config_dir                     = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] config_drive_format            = iso9660 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] config_source                  = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] console_host                   = user {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] control_exchange               = nova {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cpu_allocation_ratio           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] daemon                         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] debug                          = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] default_access_ip_network_name = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] default_availability_zone      = nova {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] default_ephemeral_format       = ext4 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] default_green_pool_size        = 1000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] default_schedule_zone          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] disk_allocation_ratio          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] enable_new_services            = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] enabled_ssl_apis               = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] flat_injected                  = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] force_config_drive             = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] force_raw_images               = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] graceful_shutdown_timeout      = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] heal_instance_info_cache_interval = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] host                           = user {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_build_timeout         = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_delete_interval       = 300 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_name_template         = instance-%08x {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_usage_audit           = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_usage_audit_period    = month {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] internal_service_availability_zone = internal {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] key                            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] live_migration_retry_count     = 30 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_config_append              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_dir                        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_file                       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_options                    = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_rotate_interval            = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_rotate_interval_type       = days {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] log_rotation_type              = none {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] long_rpc_timeout               = 1800 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] max_concurrent_builds          = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] max_concurrent_live_migrations = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] max_concurrent_snapshots       = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] max_local_block_devices        = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] max_logfile_count              = 30 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] max_logfile_size_mb            = 200 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] maximum_instance_delete_attempts = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metadata_listen                = 0.0.0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metadata_listen_port           = 8775 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metadata_workers               = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] migrate_max_retries            = -1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] mkisofs_cmd                    = genisoimage {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] my_ip                          = 10.0.0.210 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] network_allocate_retries       = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] osapi_compute_listen_port      = 8774 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] osapi_compute_unique_server_name_scope =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] osapi_compute_workers          = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] password_length                = 12 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] periodic_enable                = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] periodic_fuzzy_delay           = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] pointer_model                  = ps2mouse {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] preallocate_images             = none {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] publish_errors                 = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] pybasedir                      = /opt/stack/nova {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ram_allocation_ratio           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rate_limit_burst               = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rate_limit_except_level        = CRITICAL {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rate_limit_interval            = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reboot_timeout                 = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reclaim_instance_interval      = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] record                         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reimage_timeout_per_gb         = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] report_interval                = 120 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rescue_timeout                 = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reserved_host_cpus             = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reserved_host_disk_mb          = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reserved_host_memory_mb        = 512 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] reserved_huge_pages            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] resize_confirm_window          = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] resize_fs_using_block_device   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] resume_guests_state_on_host_boot = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rpc_response_timeout           = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] run_external_periodic_tasks    = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] running_deleted_instance_action = reap {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] running_deleted_instance_timeout = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler_instance_sync_interval = 120 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_down_time              = 720 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] servicegroup_driver            = db {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] shelved_offload_time           = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] shelved_poll_interval          = 3600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] shutdown_timeout               = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] source_is_ipv6                 = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ssl_only                       = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] state_path                     = /opt/stack/data/nova {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] sync_power_state_interval      = 600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] sync_power_state_pool_size     = 1000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] syslog_log_facility            = LOG_USER {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] tempdir                        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] timeout_nbd                    = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] transport_url                  = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] update_resources_interval      = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_cow_images                 = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_eventlog                   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_journal                    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_json                       = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_rootwrap_daemon            = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_stderr                     = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] use_syslog                     = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vcpu_pin_set                   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plugging_is_fatal          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plugging_timeout           = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] virt_mkfs                      = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] volume_usage_poll_interval     = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] watch_log_file                 = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] web                            = /usr/share/spice-html5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_concurrency.disable_process_locking = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.auth_strategy              = keystone {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.compute_link_prefix        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.dhcp_domain                = novalocal {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.enable_instance_password   = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.glance_link_prefix         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.instance_list_per_project_cells = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.list_records_by_skipping_down_cells = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.local_metadata_per_cell    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.max_limit                  = 1000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.metadata_cache_expiration  = 15 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.neutron_default_tenant_id  = default {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.use_forwarded_for          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.use_neutron_default_nets   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_dynamic_targets = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_jsonfile_path   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.backend_argument         = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.config_prefix            = cache.oslo {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.dead_timeout             = 60.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.debug_cache_backend      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.enable_retry_client      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.enable_socket_keepalive  = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.enabled                  = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.expiration_time          = 600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.hashclient_retry_attempts = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_dead_retry      = 300 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_password        =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_sasl_enabled    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.memcache_username        =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.proxies                  = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.retry_attempts           = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.retry_delay              = 0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.socket_keepalive_count   = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.socket_keepalive_idle    = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.socket_keepalive_interval = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.tls_allowed_ciphers      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.tls_cafile               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.tls_certfile             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.tls_enabled              = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cache.tls_keyfile              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.auth_section            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.auth_type               = password {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.cafile                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.certfile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.collect_timing          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.cross_az_attach         = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.debug                   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.endpoint_template       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.http_retries            = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.insecure                = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.keyfile                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.os_region_name          = RegionOne {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.split_loggers           = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cinder.timeout                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.cpu_dedicated_set      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.cpu_shared_set         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.image_type_exclude_list = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.resource_provider_association_refresh = 300 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.shutdown_retry_interval = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] conductor.workers              = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] console.allowed_origins        = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] console.ssl_ciphers            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] console.ssl_minimum_version    = default {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] consoleauth.token_ttl          = 600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.cafile                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.certfile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.collect_timing          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.connect_retries         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.connect_retry_delay     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.endpoint_override       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.insecure                = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.keyfile                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.max_version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.min_version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.region_name             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.service_name            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.service_type            = accelerator {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.split_loggers           = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.status_code_retries     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.timeout                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] cyborg.version                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.backend               = sqlalchemy {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.connection            = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.connection_debug      = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.connection_parameters =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.connection_recycle_time = 3600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.connection_trace      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.db_inc_retry_interval = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.db_max_retries        = 20 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.db_max_retry_interval = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.db_retry_interval     = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.max_overflow          = 50 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.max_pool_size         = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.max_retries           = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.mysql_wsrep_sync_wait = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.pool_timeout          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.retry_interval        = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.slave_connection      = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] database.sqlite_synchronous    = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.backend           = sqlalchemy {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.connection        = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.connection_debug  = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.connection_parameters =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.connection_recycle_time = 3600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.connection_trace  = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.db_inc_retry_interval = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.db_max_retries    = 20 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.db_max_retry_interval = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.db_retry_interval = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.max_overflow      = 50 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.max_pool_size     = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.max_retries       = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.pool_timeout      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.retry_interval    = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.slave_connection  = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] api_database.sqlite_synchronous = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] devices.enabled_mdev_types     = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ephemeral_storage_encryption.enabled = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.api_servers             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.cafile                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.certfile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.collect_timing          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.connect_retries         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.connect_retry_delay     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.debug                   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.default_trusted_certificate_ids = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.enable_certificate_validation = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.enable_rbd_download     = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.endpoint_override       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.insecure                = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.keyfile                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.max_version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.min_version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.num_retries             = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.rbd_ceph_conf           =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.rbd_connect_timeout     = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.rbd_pool                =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.rbd_user                =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.region_name             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.service_name            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.service_type            = image {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.split_loggers           = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.status_code_retries     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.timeout                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.verify_glance_signatures = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] glance.version                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] guestfs.debug                  = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.config_drive_cdrom      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.config_drive_inject_password = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.enable_remotefx         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.instances_path_share    =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.limit_cpu_features      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.use_multipath_io        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.vswitch_name            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] mks.enabled                    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] image_cache.manager_interval   = 2400 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] image_cache.precache_concurrency = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] image_cache.remove_unused_base_images = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] image_cache.subdirectory_name  = _base {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.api_max_retries         = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.api_retry_interval      = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.auth_section            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.auth_type               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.cafile                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.certfile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.collect_timing          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.conductor_group         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.connect_retries         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.connect_retry_delay     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.endpoint_override       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.insecure                = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.keyfile                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.max_version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.min_version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.peer_list               = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.region_name             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.serial_console_state_timeout = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.service_name            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.service_type            = baremetal {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.split_loggers           = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.status_code_retries     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.timeout                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ironic.version                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] key_manager.fixed_key          = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.barbican_api_version  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.barbican_endpoint     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.barbican_endpoint_type = public {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.barbican_region_name  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.cafile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.certfile              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.collect_timing        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.insecure              = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.keyfile               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.number_of_retries     = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.retry_delay           = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.send_service_user_token = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.split_loggers         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.timeout               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.verify_ssl            = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican.verify_ssl_path       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.auth_section = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.auth_type = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.cafile   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.certfile = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.collect_timing = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.insecure = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.keyfile  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.split_loggers = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] barbican_service_user.timeout  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.approle_role_id          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.approle_secret_id        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.cafile                   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.certfile                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.collect_timing           = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.insecure                 = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.keyfile                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.kv_mountpoint            = secret {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.kv_path                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.kv_version               = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.namespace                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.root_token_id            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.split_loggers            = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.ssl_ca_crt_file          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.timeout                  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.use_ssl                  = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.auth_section          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.auth_type             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.cafile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.certfile              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.collect_timing        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.connect_retries       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.connect_retry_delay   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.endpoint_override     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.insecure              = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.keyfile               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.max_version           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.min_version           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.region_name           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.service_name          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.service_type          = identity {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.split_loggers         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.status_code_retries   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.timeout               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] keystone.version               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.connection_uri         =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_mode               = custom {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: WARNING oslo_config.cfg [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_power_governor_high = performance {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_power_management   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.device_detach_attempts = 8 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.device_detach_timeout  = 20 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.disk_cachemodes        = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.disk_prefix            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.enabled_perf_events    = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.file_backed_memory     = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.gid_maps               = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.hw_disk_discard        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.hw_machine_type        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_rbd_pool        = rbd {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_type            = default {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.images_volume_group    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.inject_key             = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.inject_partition       = -2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.inject_password        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.iscsi_iface            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.iser_use_multipath     = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_downtime = 500 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_inbound_addr = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_scheme  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_timeout_action = abort {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_tunnelled = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: WARNING oslo_config.cfg [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 14:28:59 user nova-compute[75292]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 14:28:59 user nova-compute[75292]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 14:28:59 user nova-compute[75292]: and ``live_migration_inbound_addr`` respectively.
Nov 14 14:28:59 user nova-compute[75292]: ).  Its value may be silently ignored in the future.
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.live_migration_with_native_tls = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.max_queues             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.nfs_mount_options      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.num_pcie_ports         = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.pmem_namespaces        = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.quobyte_client_cfg     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rbd_secret_uuid        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rbd_user               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rescue_image_id        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rescue_kernel_id       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.rx_queue_size          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.smbfs_mount_options    =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.snapshot_compression   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.snapshot_image_format  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.sparse_logical_volumes = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.swtpm_enabled          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.swtpm_group            = tss {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.swtpm_user             = tss {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.sysinfo_serial         = unique {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.tb_cache_size          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.tx_queue_size          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.uid_maps               = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.use_virtio_for_bridges = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.virt_type              = kvm {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.volume_clear           = zero {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.volume_clear_size      = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.volume_use_multipath   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_cache_path   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.auth_section           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.auth_type              = password {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.cafile                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.certfile               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.collect_timing         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.connect_retries        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.connect_retry_delay    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.default_floating_pool  = public {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.endpoint_override      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.extension_sync_interval = 600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.http_retries           = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.insecure               = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.keyfile                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.max_version            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.min_version            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.ovs_bridge             = br-int {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.physnets               = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.region_name            = RegionOne {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.service_metadata_proxy = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.service_name           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.service_type           = network {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.split_loggers          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.status_code_retries    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.timeout                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] neutron.version                = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] notifications.bdms_in_notifications = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] notifications.default_level    = INFO {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] notifications.notification_format = unversioned {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] notifications.notify_on_state_change = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] pci.alias                      = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] pci.device_spec                = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] pci.report_in_placement        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.auth_section         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.auth_type            = password {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.cafile               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.certfile             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.collect_timing       = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.connect_retries      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.connect_retry_delay  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.default_domain_id    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.default_domain_name  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.domain_id            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.domain_name          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.endpoint_override    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.insecure             = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.keyfile              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.max_version          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.min_version          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.password             = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.project_domain_id    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.project_domain_name  = Default {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.project_id           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.project_name         = service {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.region_name          = RegionOne {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.service_name         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.service_type         = placement {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.split_loggers        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.status_code_retries  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.system_scope         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.timeout              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.trust_id             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.user_domain_id       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.user_domain_name     = Default {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.user_id              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.username             = placement {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] placement.version              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.cores                    = 20 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.count_usage_from_placement = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.injected_file_content_bytes = 10240 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.injected_file_path_length = 255 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.injected_files           = 5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.instances                = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.key_pairs                = 100 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.metadata_items           = 128 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.ram                      = 51200 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.recheck_quota            = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.server_group_members     = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] quota.server_groups            = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rdp.enabled                    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.image_metadata_prefilter = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.max_attempts         = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.max_placement_results = 1000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] scheduler.workers              = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.host_subset_size = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.isolated_hosts = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.isolated_images = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.pci_in_placement = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.track_instance_changes = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metrics.required               = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metrics.weight_multiplier      = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] metrics.weight_setting         = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] serial_console.enabled         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] serial_console.port_range      = 10000:20000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] serial_console.serialproxy_port = 6083 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.auth_section      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.auth_type         = password {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.cafile            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.certfile          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.collect_timing    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.insecure          = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.keyfile           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.send_service_user_token = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.split_loggers     = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] service_user.timeout           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.agent_enabled            = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.enabled                  = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.html5proxy_port          = 6082 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.image_compression        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.jpeg_compression         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.playback_compression     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.server_listen            = 127.0.0.1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.streaming_mode           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] spice.zlib_compression         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] upgrade_levels.baseapi         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] upgrade_levels.cert            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] upgrade_levels.compute         = auto {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] upgrade_levels.conductor       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] upgrade_levels.scheduler       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.cafile = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.certfile = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.insecure = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vendordata_dynamic_auth.timeout = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.api_retry_count         = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.ca_file                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.cache_prefix            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.cluster_name            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.connection_pool_size    = 10 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.console_delay_seconds   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.datastore_regex         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.host_ip                 = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.host_password           = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.host_port               = 443 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.host_username           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.insecure                = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.integration_bridge      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.maximum_objects         = 100 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.pbm_default_policy      = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.pbm_enabled             = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.pbm_wsdl_location       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.serial_port_proxy_uri   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.serial_port_service_uri = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.task_poll_interval      = 0.5 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.use_linked_clone        = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.vnc_keymap              = en-us {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.vnc_port                = 5900 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vmware.vnc_port_total          = 10000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.auth_schemes               = ['none'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.enabled                    = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.novncproxy_port            = 6080 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.vencrypt_ca_certs          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.vencrypt_client_cert       = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vnc.vencrypt_client_key        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.disable_rootwrap   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.enable_numa_live_migration = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.libvirt_disable_apic = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.client_socket_timeout     = 900 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.default_pool_size         = 1000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.keep_alive                = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.max_header_line           = 16384 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.ssl_ca_file               = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.ssl_cert_file             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.ssl_key_file              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.tcp_keepidle              = 600 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] zvm.ca_file                    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] zvm.cloud_connector_url        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] zvm.reachable_timeout          = 300 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.enforce_new_defaults = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.enforce_scope      = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.policy_default_rule = default {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.connection_string     = messaging:// {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.enabled               = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.es_doc_type           = notification {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.es_scroll_size        = 10000 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.es_scroll_time        = 2m {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.filter_error_trace    = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.hmac_keys             = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.sentinel_service_name = mymaster {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.socket_timeout        = 0.1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.trace_requests        = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler.trace_sqlalchemy      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler_jaeger.process_tags   = {} {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler_jaeger.service_name_prefix = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] profiler_otlp.service_name_prefix = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] remote_debug.host              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] remote_debug.port              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_notifications.retry = -1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.auth_section        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.auth_type           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.cafile              = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.certfile            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.collect_timing      = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.connect_retries     = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.connect_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.endpoint_id         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.endpoint_override   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.insecure            = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.keyfile             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.max_version         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.min_version         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.region_name         = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.service_name        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.service_type        = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.split_loggers       = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.status_code_retries = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.status_code_retry_delay = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.timeout             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.valid_interfaces    = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_limit.version             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_reports.file_event_handler = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] oslo_reports.log_dir           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_ovs_privileged.group  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] vif_plug_ovs_privileged.user   = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.isolate_vif         = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] os_brick.lock_path             = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] privsep_osbrick.capabilities   = [21] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] privsep_osbrick.group          = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] privsep_osbrick.helper_command = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] privsep_osbrick.user           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] nova_sys_admin.group           = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] nova_sys_admin.helper_command  = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] nova_sys_admin.user            = None {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG oslo_service.service [None req-2d061c92-a996-45e5-aecd-ae92caa6b555 None None] ******************************************************************************** {{(pid=75292) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 14:28:59 user nova-compute[75292]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Connecting to libvirt: qemu:///system {{(pid=75292) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2b7540ef50> {{(pid=75292) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 14:28:59 user nova-compute[75292]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 14:28:59 user nova-compute[75292]: WARNING nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2b7540ef50> {{(pid=75292) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Starting native event thread {{(pid=75292) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Starting green dispatch thread {{(pid=75292) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Starting connection event dispatch thread {{(pid=75292) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 14:28:59 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Connection event '1' reason 'None'
Nov 14 14:28:59 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 14:28:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.mount [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Initialising _HostMountState generation 0 {{(pid=75292) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 14:29:06 user nova-compute[75292]: INFO nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host capabilities <capabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <host>
Nov 14 14:29:06 user nova-compute[75292]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 14:29:06 user nova-compute[75292]:     <cpu>
Nov 14 14:29:06 user nova-compute[75292]:       <arch>x86_64</arch>
Nov 14 14:29:06 user nova-compute[75292]:       <model>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <microcode version='1070'/>
Nov 14 14:29:06 user nova-compute[75292]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='osxsave'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='invtsc'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='rsba'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 14:29:06 user nova-compute[75292]:       <pages unit='KiB' size='4'/>
Nov 14 14:29:06 user nova-compute[75292]:       <pages unit='KiB' size='2048'/>
Nov 14 14:29:06 user nova-compute[75292]:     </cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <power_management>
Nov 14 14:29:06 user nova-compute[75292]:       <suspend_mem/>
Nov 14 14:29:06 user nova-compute[75292]:       <suspend_disk/>
Nov 14 14:29:06 user nova-compute[75292]:       <suspend_hybrid/>
Nov 14 14:29:06 user nova-compute[75292]:     </power_management>
Nov 14 14:29:06 user nova-compute[75292]:     <iommu support='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <migration_features>
Nov 14 14:29:06 user nova-compute[75292]:       <live/>
Nov 14 14:29:06 user nova-compute[75292]:       <uri_transports>
Nov 14 14:29:06 user nova-compute[75292]:         <uri_transport>tcp</uri_transport>
Nov 14 14:29:06 user nova-compute[75292]:         <uri_transport>rdma</uri_transport>
Nov 14 14:29:06 user nova-compute[75292]:       </uri_transports>
Nov 14 14:29:06 user nova-compute[75292]:     </migration_features>
Nov 14 14:29:06 user nova-compute[75292]:     <topology>
Nov 14 14:29:06 user nova-compute[75292]:       <cells num='2'>
Nov 14 14:29:06 user nova-compute[75292]:         <cell id='0'>
Nov 14 14:29:06 user nova-compute[75292]:           <memory unit='KiB'>8189224</memory>
Nov 14 14:29:06 user nova-compute[75292]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 14:29:06 user nova-compute[75292]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 14:29:06 user nova-compute[75292]:           <distances>
Nov 14 14:29:06 user nova-compute[75292]:             <sibling id='0' value='10'/>
Nov 14 14:29:06 user nova-compute[75292]:             <sibling id='1' value='20'/>
Nov 14 14:29:06 user nova-compute[75292]:           </distances>
Nov 14 14:29:06 user nova-compute[75292]:           <cpus num='6'>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 14:29:06 user nova-compute[75292]:           </cpus>
Nov 14 14:29:06 user nova-compute[75292]:         </cell>
Nov 14 14:29:06 user nova-compute[75292]:         <cell id='1'>
Nov 14 14:29:06 user nova-compute[75292]:           <memory unit='KiB'>8206460</memory>
Nov 14 14:29:06 user nova-compute[75292]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 14:29:06 user nova-compute[75292]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 14:29:06 user nova-compute[75292]:           <distances>
Nov 14 14:29:06 user nova-compute[75292]:             <sibling id='0' value='20'/>
Nov 14 14:29:06 user nova-compute[75292]:             <sibling id='1' value='10'/>
Nov 14 14:29:06 user nova-compute[75292]:           </distances>
Nov 14 14:29:06 user nova-compute[75292]:           <cpus num='6'>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 14:29:06 user nova-compute[75292]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 14:29:06 user nova-compute[75292]:           </cpus>
Nov 14 14:29:06 user nova-compute[75292]:         </cell>
Nov 14 14:29:06 user nova-compute[75292]:       </cells>
Nov 14 14:29:06 user nova-compute[75292]:     </topology>
Nov 14 14:29:06 user nova-compute[75292]:     <cache>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 14:29:06 user nova-compute[75292]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 14:29:06 user nova-compute[75292]:     </cache>
Nov 14 14:29:06 user nova-compute[75292]:     <secmodel>
Nov 14 14:29:06 user nova-compute[75292]:       <model>apparmor</model>
Nov 14 14:29:06 user nova-compute[75292]:       <doi>0</doi>
Nov 14 14:29:06 user nova-compute[75292]:     </secmodel>
Nov 14 14:29:06 user nova-compute[75292]:     <secmodel>
Nov 14 14:29:06 user nova-compute[75292]:       <model>dac</model>
Nov 14 14:29:06 user nova-compute[75292]:       <doi>0</doi>
Nov 14 14:29:06 user nova-compute[75292]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 14:29:06 user nova-compute[75292]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 14:29:06 user nova-compute[75292]:     </secmodel>
Nov 14 14:29:06 user nova-compute[75292]:   </host>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='alpha'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>clipper</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='armv6l'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>spitz</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>nuri</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>kzm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sx1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>z2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>tosa</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>n810</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>n800</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>terrier</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>midway</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>microbit</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>verdex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>highbank</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>akita</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>connex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>collie</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='armv7l'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>spitz</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>nuri</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>kzm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sx1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>z2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>tosa</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>n810</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>n800</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>terrier</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>midway</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>microbit</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>verdex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>highbank</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>akita</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>connex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>collie</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='aarch64'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>spitz</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>nuri</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>kzm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sx1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>z2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>tosa</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>n810</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>n800</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>terrier</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>midway</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>microbit</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>verdex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>highbank</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>akita</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>connex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>collie</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <acpi default='on' toggle='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='cris'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='i686'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>isapc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>microvm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='kvm'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <pae/>
Nov 14 14:29:06 user nova-compute[75292]:       <nonpae/>
Nov 14 14:29:06 user nova-compute[75292]:       <acpi default='on' toggle='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:       <apic default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='m68k'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>an5206</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>q800</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='microblaze'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='microblazeel'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='mips'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='16'>malta</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='mipsel'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='16'>malta</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='mips64'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='16'>malta</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>pica61</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>magnum</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='mips64el'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='16'>malta</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>pica61</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>magnum</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='16'>boston</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='ppc'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mac99</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>40p</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>taihu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='ppc64'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>taihu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>40p</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mac99</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='ppc64le'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>taihu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>40p</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>mac99</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='riscv32'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='8'>spike</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='8'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='riscv64'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='8'>spike</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='8'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='s390x'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='sh4'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>shix</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>r2d</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='sh4eb'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>shix</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>r2d</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='sparc'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>LX</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='sparc64'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>niagara</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='x86_64'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>64</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='1'>isapc</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>microvm</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='kvm'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <acpi default='on' toggle='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:       <apic default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='xtensa'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>sim</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>kc705</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ml605</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx200</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx60</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]:   <guest>
Nov 14 14:29:06 user nova-compute[75292]:     <os_type>hvm</os_type>
Nov 14 14:29:06 user nova-compute[75292]:     <arch name='xtensaeb'>
Nov 14 14:29:06 user nova-compute[75292]:       <wordsize>32</wordsize>
Nov 14 14:29:06 user nova-compute[75292]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='4'>sim</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>kc705</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ml605</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>virt</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx200</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>lx60</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 14:29:06 user nova-compute[75292]:       <domain type='qemu'/>
Nov 14 14:29:06 user nova-compute[75292]:     </arch>
Nov 14 14:29:06 user nova-compute[75292]:     <features>
Nov 14 14:29:06 user nova-compute[75292]:       <cpuselection/>
Nov 14 14:29:06 user nova-compute[75292]:       <deviceboot/>
Nov 14 14:29:06 user nova-compute[75292]:       <disksnapshot default='on' toggle='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     </features>
Nov 14 14:29:06 user nova-compute[75292]:   </guest>
Nov 14 14:29:06 user nova-compute[75292]: </capabilities>
Nov 14 14:29:06 user nova-compute[75292]: 
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-q35-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>i686</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='288'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'/>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='lm'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-i440fx-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>i686</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='255'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'/>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='lm'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ide</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-q35-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>i686</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='288'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'/>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='lm'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-i440fx-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>i686</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='255'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'/>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='lm'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ide</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-q35-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>x86_64</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='288'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>efi</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='invtsc'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='rsba'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-i440fx-6.2</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>x86_64</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='255'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>efi</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='invtsc'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='rsba'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ide</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-q35-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>x86_64</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='288'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>efi</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='invtsc'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='rsba'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 14:29:06 user nova-compute[75292]: <domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 14:29:06 user nova-compute[75292]:   <domain>kvm</domain>
Nov 14 14:29:06 user nova-compute[75292]:   <machine>pc-i440fx-jammy</machine>
Nov 14 14:29:06 user nova-compute[75292]:   <arch>x86_64</arch>
Nov 14 14:29:06 user nova-compute[75292]:   <vcpu max='255'/>
Nov 14 14:29:06 user nova-compute[75292]:   <iothreads supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:   <os supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='firmware'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>efi</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:     <loader supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>rom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pflash</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='readonly'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>yes</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='secure'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>no</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </loader>
Nov 14 14:29:06 user nova-compute[75292]:   </os>
Nov 14 14:29:06 user nova-compute[75292]:   <cpu>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-passthrough' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='hostPassthroughMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='maximum' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='maximumMigratable'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>on</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>off</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='host-model' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <vendor>Intel</vendor>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ss'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='vmx'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pcid'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='hypervisor'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arat'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='umip'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='md-clear'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='invtsc'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibpb'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='ibrs'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-stibp'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='rsba'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='erms'/>
Nov 14 14:29:06 user nova-compute[75292]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:     <mode name='custom' supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>qemu64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>qemu32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>phenom</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>pentium</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>n270</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm64</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>kvm32</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>coreduo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>core2duo</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>athlon</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Westmere</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Snowridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Skylake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>SandyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Penryn</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G5</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G4</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G3</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Opteron_G2</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Opteron_G1</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>IvyBridge</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Icelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Haswell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Rome</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-Milan</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>EPYC</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Dhyana</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cooperlake</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>Conroe</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='no'>Broadwell</model>
Nov 14 14:29:06 user nova-compute[75292]:       <model usable='yes'>486</model>
Nov 14 14:29:06 user nova-compute[75292]:     </mode>
Nov 14 14:29:06 user nova-compute[75292]:   </cpu>
Nov 14 14:29:06 user nova-compute[75292]:   <memoryBacking supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:     <enum name='sourceType'>
Nov 14 14:29:06 user nova-compute[75292]:       <value>file</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>anonymous</value>
Nov 14 14:29:06 user nova-compute[75292]:       <value>memfd</value>
Nov 14 14:29:06 user nova-compute[75292]:     </enum>
Nov 14 14:29:06 user nova-compute[75292]:   </memoryBacking>
Nov 14 14:29:06 user nova-compute[75292]:   <devices>
Nov 14 14:29:06 user nova-compute[75292]:     <disk supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='diskDevice'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>disk</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cdrom</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>floppy</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>lun</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='bus'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ide</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>fdc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sata</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </disk>
Nov 14 14:29:06 user nova-compute[75292]:     <graphics supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='type'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>sdl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vnc</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>spice</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egl-headless</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </graphics>
Nov 14 14:29:06 user nova-compute[75292]:     <video supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='modelType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>cirrus</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>vmvga</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>qxl</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>none</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>bochs</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>ramfb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </video>
Nov 14 14:29:06 user nova-compute[75292]:     <hostdev supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='mode'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>subsystem</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='startupPolicy'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>default</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>mandatory</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>requisite</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>optional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='subsysType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>usb</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>pci</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>scsi</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='capsType'/>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='pciBackend'/>
Nov 14 14:29:06 user nova-compute[75292]:     </hostdev>
Nov 14 14:29:06 user nova-compute[75292]:     <rng supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtio-non-transitional</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>random</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>egd</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>builtin</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </rng>
Nov 14 14:29:06 user nova-compute[75292]:     <filesystem supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='driverType'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>path</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>handle</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>virtiofs</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </filesystem>
Nov 14 14:29:06 user nova-compute[75292]:     <tpm supported='yes'>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='model'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-tis</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>tpm-crb</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:       <enum name='backendModel'>
Nov 14 14:29:06 user nova-compute[75292]:         <value>passthrough</value>
Nov 14 14:29:06 user nova-compute[75292]:         <value>emulator</value>
Nov 14 14:29:06 user nova-compute[75292]:       </enum>
Nov 14 14:29:06 user nova-compute[75292]:     </tpm>
Nov 14 14:29:06 user nova-compute[75292]:   </devices>
Nov 14 14:29:06 user nova-compute[75292]:   <features>
Nov 14 14:29:06 user nova-compute[75292]:     <gic supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:     <vmcoreinfo supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <genid supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backingStoreInput supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <backup supported='yes'/>
Nov 14 14:29:06 user nova-compute[75292]:     <sev supported='no'/>
Nov 14 14:29:06 user nova-compute[75292]:   </features>
Nov 14 14:29:06 user nova-compute[75292]: </domainCapabilities>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75292) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75292) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Checking secure boot support for host arch (x86_64) {{(pid=75292) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 14:29:06 user nova-compute[75292]: INFO nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Secure Boot support detected
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] cpu compare xml: <cpu match="exact">
Nov 14 14:29:06 user nova-compute[75292]:   <model>Nehalem</model>
Nov 14 14:29:06 user nova-compute[75292]: </cpu>
Nov 14 14:29:06 user nova-compute[75292]:  {{(pid=75292) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 14:29:06 user nova-compute[75292]: INFO nova.virt.node [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Generated node identity 09e514fa-427e-42ca-8897-f1a398f916a9
Nov 14 14:29:06 user nova-compute[75292]: INFO nova.virt.node [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Wrote node identity 09e514fa-427e-42ca-8897-f1a398f916a9 to /opt/stack/data/nova/compute_id
Nov 14 14:29:06 user nova-compute[75292]: WARNING nova.compute.manager [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Compute nodes ['09e514fa-427e-42ca-8897-f1a398f916a9'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 14:29:06 user nova-compute[75292]: INFO nova.compute.manager [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 14:29:06 user nova-compute[75292]: WARNING nova.compute.manager [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 14:29:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:29:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:29:07 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:29:07 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Hypervisor/Node resource view: name=user free_ram=10932MB free_disk=26.242698669433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:29:07 user nova-compute[75292]: WARNING nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] No compute node record for user:09e514fa-427e-42ca-8897-f1a398f916a9: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 09e514fa-427e-42ca-8897-f1a398f916a9 could not be found.
Nov 14 14:29:07 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Compute node record created for user:user with uuid: 09e514fa-427e-42ca-8897-f1a398f916a9
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:29:07 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] [req-ee6a91fb-2ca3-4d2a-be3b-95aee07eaaf8] Created resource provider record via placement API for resource provider with UUID 09e514fa-427e-42ca-8897-f1a398f916a9 and name user.
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75292) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 14:29:07 user nova-compute[75292]: INFO nova.virt.libvirt.host [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] kernel doesn't support AMD SEV
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Libvirt baseline CPU <cpu>
Nov 14 14:29:07 user nova-compute[75292]:   <arch>x86_64</arch>
Nov 14 14:29:07 user nova-compute[75292]:   <model>Nehalem</model>
Nov 14 14:29:07 user nova-compute[75292]:   <vendor>Intel</vendor>
Nov 14 14:29:07 user nova-compute[75292]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 14:29:07 user nova-compute[75292]: </cpu>
Nov 14 14:29:07 user nova-compute[75292]:  {{(pid=75292) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Updated inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Updating resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 generation from 0 to 1 during operation: update_inventory {{(pid=75292) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Updating resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 generation from 1 to 2 during operation: update_traits {{(pid=75292) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.service [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Creating RPC server for service compute {{(pid=75292) start /opt/stack/nova/nova/service.py:182}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.service [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] Join ServiceGroup membership for this service compute {{(pid=75292) start /opt/stack/nova/nova/service.py:199}}
Nov 14 14:29:07 user nova-compute[75292]: DEBUG nova.servicegroup.drivers.db [None req-c187851e-2f26-4282-a27e-7a323ba47327 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75292) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 14:29:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:29:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:29:59 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:29:59 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:29:59 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=10355MB free_disk=26.146461486816406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:29:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:30:59 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:31:00 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:31:00 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:31:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=10292MB free_disk=26.19970703125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:31:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:31:01 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:31:01 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:31:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:31:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:32:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:32:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:32:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:32:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=10299MB free_disk=25.963306427001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:32:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:32:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:32:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:32:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:33:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9600MB free_disk=25.983200073242188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:33:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:33:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:09 user nova-compute[75292]: INFO nova.compute.claims [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Claim successful on node user
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.094s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:09 user nova-compute[75292]: INFO nova.compute.claims [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Claim successful on node user
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Creating image(s)
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.policy [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9970be0d6d0a4c7193237192da054e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850c4eb7326f46c59998de50b99686c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.policy [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44e3e41e693f47bdae15a362ba3d5344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34612ba41d07410b8d6f934e759f0073', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.part --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.virt.images [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] bf213fca-dee8-42b3-bde7-bb229ab5915b was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.part /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Creating image(s)
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.part /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.converted" returned: 0 in 0.157s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.259s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:11 user nova-compute[75292]: INFO oslo.privsep.daemon [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptn79jgiw/privsep.sock']
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.325s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:11 user sudo[84550]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptn79jgiw/privsep.sock
Nov 14 14:33:11 user sudo[84550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:11 user nova-compute[75292]: INFO nova.compute.claims [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Claim successful on node user
Nov 14 14:33:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.304s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:12 user nova-compute[75292]: INFO nova.compute.claims [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Claim successful on node user
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Creating image(s)
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:12 user sudo[84550]: pam_unix(sudo:session): session closed for user root
Nov 14 14:33:12 user nova-compute[75292]: INFO oslo.privsep.daemon [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Spawned new privsep daemon via rootwrap
Nov 14 14:33:12 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 14:33:12 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 14:33:12 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 14:33:12 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84557
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:12 user nova-compute[75292]: WARNING oslo_privsep.priv_context [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] privsep daemon already running
Nov 14 14:33:12 user nova-compute[75292]: WARNING oslo_privsep.priv_context [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] privsep daemon already running
Nov 14 14:33:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.policy [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9970be0d6d0a4c7193237192da054e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850c4eb7326f46c59998de50b99686c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Creating image(s)
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "/opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "/opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "/opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG nova.policy [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e75042706a2347ebba11d20ba65ba282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b7e88c2e88460484f06a772b1f60c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk 1073741824" returned: 0 in 0.044s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.210s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Successfully created port: 81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk 1073741824" returned: 0 in 0.053s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.470s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Successfully created port: 681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Cannot resize image /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk 1073741824" returned: 0 in 0.041s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.674s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Cannot resize image /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Ensure instance console log exists: /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk 1073741824" returned: 0 in 0.047s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Cannot resize image /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Ensure instance console log exists: /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Cannot resize image /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Ensure instance console log exists: /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Successfully created port: f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Successfully created port: efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Successfully updated port: 81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Successfully updated port: 681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-changed-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Refreshing instance network info cache due to event network-changed-81d5c23c-2743-4ba8-a05f-a5c91722f552. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Successfully updated port: f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-changed-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Refreshing instance network info cache due to event network-changed-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] Acquiring lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Successfully updated port: efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance network_info: |[{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Refreshing network info cache for port 81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Start _get_guest_xml network_info=[{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1903340639',display_name='tempest-ServerRescueNegativeTestJSON-server-1903340639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1903340639',id=1,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-rbudekua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:10Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=e5865b32-ff16-4409-9130-4ac985de81ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'pci_devices' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:18 user nova-compute[75292]:   <uuid>e5865b32-ff16-4409-9130-4ac985de81ca</uuid>
Nov 14 14:33:18 user nova-compute[75292]:   <name>instance-00000001</name>
Nov 14 14:33:18 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:18 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:18 user nova-compute[75292]:   <metadata>
Nov 14 14:33:18 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:18 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1903340639</nova:name>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:18</nova:creationTime>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:18 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:user uuid="9970be0d6d0a4c7193237192da054e8c">tempest-ServerRescueNegativeTestJSON-1737174677-project-member</nova:user>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:project uuid="850c4eb7326f46c59998de50b99686c0">tempest-ServerRescueNegativeTestJSON-1737174677</nova:project>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:port uuid="81d5c23c-2743-4ba8-a05f-a5c91722f552">
Nov 14 14:33:18 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 14:33:18 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:18 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:18 user nova-compute[75292]:   </metadata>
Nov 14 14:33:18 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:18 user nova-compute[75292]:     <system>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="serial">e5865b32-ff16-4409-9130-4ac985de81ca</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="uuid">e5865b32-ff16-4409-9130-4ac985de81ca</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:18 user nova-compute[75292]:     </system>
Nov 14 14:33:18 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:18 user nova-compute[75292]:   <os>
Nov 14 14:33:18 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:18 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:18 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:18 user nova-compute[75292]:   </os>
Nov 14 14:33:18 user nova-compute[75292]:   <features>
Nov 14 14:33:18 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:18 user nova-compute[75292]:     <apic/>
Nov 14 14:33:18 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:18 user nova-compute[75292]:   </features>
Nov 14 14:33:18 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:18 user nova-compute[75292]:   </clock>
Nov 14 14:33:18 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:18 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:18 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:18 user nova-compute[75292]:   </cpu>
Nov 14 14:33:18 user nova-compute[75292]:   <devices>
Nov 14 14:33:18 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:18 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:18 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk"/>
Nov 14 14:33:18 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:     </disk>
Nov 14 14:33:18 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:18 user nova-compute[75292]:       <mac address="fa:16:3e:67:e1:18"/>
Nov 14 14:33:18 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:18 user nova-compute[75292]:       <target dev="tap81d5c23c-27"/>
Nov 14 14:33:18 user nova-compute[75292]:     </interface>
Nov 14 14:33:18 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:18 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/console.log" append="off"/>
Nov 14 14:33:18 user nova-compute[75292]:     </serial>
Nov 14 14:33:18 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:18 user nova-compute[75292]:     <video>
Nov 14 14:33:18 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:     </video>
Nov 14 14:33:18 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:18 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:18 user nova-compute[75292]:     </rng>
Nov 14 14:33:18 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:18 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:18 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:18 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:18 user nova-compute[75292]:   </devices>
Nov 14 14:33:18 user nova-compute[75292]: </domain>
Nov 14 14:33:18 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1903340639',display_name='tempest-ServerRescueNegativeTestJSON-server-1903340639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1903340639',id=1,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-rbudekua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:10Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=e5865b32-ff16-4409-9130-4ac985de81ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG os_vif [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Created schema index Interface.name {{(pid=75292) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Created schema index Port.name {{(pid=75292) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Created schema index Bridge.name {{(pid=75292) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance network_info: |[{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [POLLOUT] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start _get_guest_xml network_info=[{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-changed-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Refreshing instance network info cache due to event network-changed-efebda64-96d8-427d-b777-b43803cb2e92. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf758f1a-c180-55fd-b6be-f3cb87853da5', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:18 user nova-compute[75292]: INFO oslo.privsep.daemon [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp90ji_cnp/privsep.sock']
Nov 14 14:33:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:18 user sudo[84631]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp90ji_cnp/privsep.sock
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:18 user sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'pci_devices' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:18 user nova-compute[75292]:   <uuid>c5ce2080-b527-4c87-b422-6de3f2d0c4d7</uuid>
Nov 14 14:33:18 user nova-compute[75292]:   <name>instance-00000002</name>
Nov 14 14:33:18 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:18 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:18 user nova-compute[75292]:   <metadata>
Nov 14 14:33:18 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:18 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherB-server-2014877484</nova:name>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:18</nova:creationTime>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:18 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:user uuid="44e3e41e693f47bdae15a362ba3d5344">tempest-ServerActionsTestOtherB-1910038092-project-member</nova:user>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:project uuid="34612ba41d07410b8d6f934e759f0073">tempest-ServerActionsTestOtherB-1910038092</nova:project>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:port uuid="681ed373-e78f-4440-9658-ae5f20726f63">
Nov 14 14:33:18 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:33:18 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:18 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:18 user nova-compute[75292]:   </metadata>
Nov 14 14:33:18 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:18 user nova-compute[75292]:     <system>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="serial">c5ce2080-b527-4c87-b422-6de3f2d0c4d7</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="uuid">c5ce2080-b527-4c87-b422-6de3f2d0c4d7</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:18 user nova-compute[75292]:     </system>
Nov 14 14:33:18 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:18 user nova-compute[75292]:   <os>
Nov 14 14:33:18 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:18 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:18 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:18 user nova-compute[75292]:   </os>
Nov 14 14:33:18 user nova-compute[75292]:   <features>
Nov 14 14:33:18 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:18 user nova-compute[75292]:     <apic/>
Nov 14 14:33:18 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:18 user nova-compute[75292]:   </features>
Nov 14 14:33:18 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:18 user nova-compute[75292]:   </clock>
Nov 14 14:33:18 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:18 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:18 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:18 user nova-compute[75292]:   </cpu>
Nov 14 14:33:18 user nova-compute[75292]:   <devices>
Nov 14 14:33:18 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:18 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:18 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk"/>
Nov 14 14:33:18 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:     </disk>
Nov 14 14:33:18 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:18 user nova-compute[75292]:       <mac address="fa:16:3e:73:d7:5d"/>
Nov 14 14:33:18 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:18 user nova-compute[75292]:       <target dev="tap681ed373-e7"/>
Nov 14 14:33:18 user nova-compute[75292]:     </interface>
Nov 14 14:33:18 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:18 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/console.log" append="off"/>
Nov 14 14:33:18 user nova-compute[75292]:     </serial>
Nov 14 14:33:18 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:18 user nova-compute[75292]:     <video>
Nov 14 14:33:18 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:     </video>
Nov 14 14:33:18 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:18 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:18 user nova-compute[75292]:     </rng>
Nov 14 14:33:18 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:18 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:18 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:18 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:18 user nova-compute[75292]:   </devices>
Nov 14 14:33:18 user nova-compute[75292]: </domain>
Nov 14 14:33:18 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG os_vif [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f9440f1-1d40-52fc-b258-491074a03491', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance network_info: |[{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] Acquired lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Refreshing network info cache for port f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Start _get_guest_xml network_info=[{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1530529335',display_name='tempest-ServerRescueNegativeTestJSON-server-1530529335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1530529335',id=3,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-fiv5ql8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:12Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=fcc51f4f-7b46-4475-9cbf-53421eb0803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'pci_devices' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:18 user nova-compute[75292]:   <uuid>fcc51f4f-7b46-4475-9cbf-53421eb0803f</uuid>
Nov 14 14:33:18 user nova-compute[75292]:   <name>instance-00000003</name>
Nov 14 14:33:18 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:18 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:18 user nova-compute[75292]:   <metadata>
Nov 14 14:33:18 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:18 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1530529335</nova:name>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:18</nova:creationTime>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:18 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:user uuid="9970be0d6d0a4c7193237192da054e8c">tempest-ServerRescueNegativeTestJSON-1737174677-project-member</nova:user>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:project uuid="850c4eb7326f46c59998de50b99686c0">tempest-ServerRescueNegativeTestJSON-1737174677</nova:project>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:33:18 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:18 user nova-compute[75292]:         <nova:port uuid="f34cfacd-c6a0-40a5-894b-98b4c7c5cf47">
Nov 14 14:33:18 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 14:33:18 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:18 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:18 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:18 user nova-compute[75292]:   </metadata>
Nov 14 14:33:18 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:18 user nova-compute[75292]:     <system>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="serial">fcc51f4f-7b46-4475-9cbf-53421eb0803f</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="uuid">fcc51f4f-7b46-4475-9cbf-53421eb0803f</entry>
Nov 14 14:33:18 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:18 user nova-compute[75292]:     </system>
Nov 14 14:33:18 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:18 user nova-compute[75292]:   <os>
Nov 14 14:33:18 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:18 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:18 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:18 user nova-compute[75292]:   </os>
Nov 14 14:33:18 user nova-compute[75292]:   <features>
Nov 14 14:33:18 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:18 user nova-compute[75292]:     <apic/>
Nov 14 14:33:18 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:18 user nova-compute[75292]:   </features>
Nov 14 14:33:18 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:18 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:18 user nova-compute[75292]:   </clock>
Nov 14 14:33:18 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:18 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:18 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:18 user nova-compute[75292]:   </cpu>
Nov 14 14:33:18 user nova-compute[75292]:   <devices>
Nov 14 14:33:18 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:18 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:18 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk"/>
Nov 14 14:33:18 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:     </disk>
Nov 14 14:33:18 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:18 user nova-compute[75292]:       <mac address="fa:16:3e:4d:f2:d8"/>
Nov 14 14:33:18 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:18 user nova-compute[75292]:       <target dev="tapf34cfacd-c6"/>
Nov 14 14:33:18 user nova-compute[75292]:     </interface>
Nov 14 14:33:18 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:18 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/console.log" append="off"/>
Nov 14 14:33:18 user nova-compute[75292]:     </serial>
Nov 14 14:33:18 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:18 user nova-compute[75292]:     <video>
Nov 14 14:33:18 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:18 user nova-compute[75292]:     </video>
Nov 14 14:33:18 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:18 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:18 user nova-compute[75292]:     </rng>
Nov 14 14:33:18 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:18 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:18 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:18 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:18 user nova-compute[75292]:   </devices>
Nov 14 14:33:18 user nova-compute[75292]: </domain>
Nov 14 14:33:18 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1530529335',display_name='tempest-ServerRescueNegativeTestJSON-server-1530529335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1530529335',id=3,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-fiv5ql8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:12Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=fcc51f4f-7b46-4475-9cbf-53421eb0803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG os_vif [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c93a4a1-b323-5645-9bc0-bd28441c4acc', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-changed-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Refreshing instance network info cache due to event network-changed-681ed373-e78f-4440-9658-ae5f20726f63. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Refreshing network info cache for port 681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Instance network_info: |[{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Refreshing network info cache for port efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Start _get_guest_xml network_info=[{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:19 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:19 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1619315554',display_name='tempest-ServerActionsTestOtherA-server-1619315554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1619315554',id=4,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-yuzz3ojn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=c75f05cb-4b25-4c55-81f6-4853a6ee4938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.objects.instance [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'pci_devices' on Instance uuid c75f05cb-4b25-4c55-81f6-4853a6ee4938 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:19 user nova-compute[75292]:   <uuid>c75f05cb-4b25-4c55-81f6-4853a6ee4938</uuid>
Nov 14 14:33:19 user nova-compute[75292]:   <name>instance-00000004</name>
Nov 14 14:33:19 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:19 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:19 user nova-compute[75292]:   <metadata>
Nov 14 14:33:19 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:19 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:19 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherA-server-1619315554</nova:name>
Nov 14 14:33:19 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:19</nova:creationTime>
Nov 14 14:33:19 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:19 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:19 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:19 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:user uuid="e75042706a2347ebba11d20ba65ba282">tempest-ServerActionsTestOtherA-1545988335-project-member</nova:user>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:project uuid="54b7e88c2e88460484f06a772b1f60c3">tempest-ServerActionsTestOtherA-1545988335</nova:project>
Nov 14 14:33:19 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:19 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:33:19 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:19 user nova-compute[75292]:         <nova:port uuid="efebda64-96d8-427d-b777-b43803cb2e92">
Nov 14 14:33:19 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 14:33:19 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:19 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:19 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:19 user nova-compute[75292]:   </metadata>
Nov 14 14:33:19 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:19 user nova-compute[75292]:     <system>
Nov 14 14:33:19 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:19 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:19 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:19 user nova-compute[75292]:       <entry name="serial">c75f05cb-4b25-4c55-81f6-4853a6ee4938</entry>
Nov 14 14:33:19 user nova-compute[75292]:       <entry name="uuid">c75f05cb-4b25-4c55-81f6-4853a6ee4938</entry>
Nov 14 14:33:19 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:19 user nova-compute[75292]:     </system>
Nov 14 14:33:19 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:19 user nova-compute[75292]:   <os>
Nov 14 14:33:19 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:19 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:19 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:19 user nova-compute[75292]:   </os>
Nov 14 14:33:19 user nova-compute[75292]:   <features>
Nov 14 14:33:19 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:19 user nova-compute[75292]:     <apic/>
Nov 14 14:33:19 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:19 user nova-compute[75292]:   </features>
Nov 14 14:33:19 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:19 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:19 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:19 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:19 user nova-compute[75292]:   </clock>
Nov 14 14:33:19 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:19 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:19 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:19 user nova-compute[75292]:   </cpu>
Nov 14 14:33:19 user nova-compute[75292]:   <devices>
Nov 14 14:33:19 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:19 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:19 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk"/>
Nov 14 14:33:19 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:33:19 user nova-compute[75292]:     </disk>
Nov 14 14:33:19 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:19 user nova-compute[75292]:       <mac address="fa:16:3e:12:40:c0"/>
Nov 14 14:33:19 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:19 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:19 user nova-compute[75292]:       <target dev="tapefebda64-96"/>
Nov 14 14:33:19 user nova-compute[75292]:     </interface>
Nov 14 14:33:19 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:19 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/console.log" append="off"/>
Nov 14 14:33:19 user nova-compute[75292]:     </serial>
Nov 14 14:33:19 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:19 user nova-compute[75292]:     <video>
Nov 14 14:33:19 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:19 user nova-compute[75292]:     </video>
Nov 14 14:33:19 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:19 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:19 user nova-compute[75292]:     </rng>
Nov 14 14:33:19 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:19 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:19 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:19 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:19 user nova-compute[75292]:   </devices>
Nov 14 14:33:19 user nova-compute[75292]: </domain>
Nov 14 14:33:19 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1619315554',display_name='tempest-ServerActionsTestOtherA-server-1619315554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1619315554',id=4,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-yuzz3ojn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=c75f05cb-4b25-4c55-81f6-4853a6ee4938,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG os_vif [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04a09df9-c165-5b1e-be0d-284de2eb0567', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updated VIF entry in instance network info cache for port f34cfacd-c6a0-40a5-894b-98b4c7c5cf47. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d1d282a5-e7c2-479e-8229-1e99ea3205d1 req-bb2c50ab-8b62-4f3a-9987-7b92848cc92f service nova] Releasing lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updated VIF entry in instance network info cache for port 81d5c23c-2743-4ba8-a05f-a5c91722f552. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a2a545b1-f923-4f38-b914-bb8f57741e17 req-98c35c08-1955-4331-9cf5-8cc96b7c6fbe service nova] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updated VIF entry in instance network info cache for port efebda64-96d8-427d-b777-b43803cb2e92. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-32ceef4c-901c-4645-948b-e1a690c7cce6 req-de18f36d-89ba-4a59-b92c-0c3ae671d089 service nova] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:20 user sudo[84631]: pam_unix(sudo:session): session closed for user root
Nov 14 14:33:20 user nova-compute[75292]: INFO oslo.privsep.daemon [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Spawned new privsep daemon via rootwrap
Nov 14 14:33:20 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 14:33:20 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 14:33:20 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 14:33:20 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84634
Nov 14 14:33:20 user nova-compute[75292]: WARNING oslo_privsep.priv_context [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] privsep daemon already running
Nov 14 14:33:20 user nova-compute[75292]: WARNING oslo_privsep.priv_context [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] privsep daemon already running
Nov 14 14:33:20 user nova-compute[75292]: WARNING oslo_privsep.priv_context [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] privsep daemon already running
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updated VIF entry in instance network info cache for port 681ed373-e78f-4440-9658-ae5f20726f63. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-722d80cf-3e94-4cfa-aa3f-1dd2437aaab6 req-0aee7e36-bd27-490e-988e-66928e6fcfb3 service nova] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap681ed373-e7, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap681ed373-e7, col_values=(('qos', UUID('d922543d-5d55-43d3-af13-6bc36e965d7f')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap681ed373-e7, col_values=(('external_ids', {'iface-id': '681ed373-e78f-4440-9658-ae5f20726f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:d7:5d', 'vm-uuid': 'c5ce2080-b527-4c87-b422-6de3f2d0c4d7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: INFO os_vif [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7')
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefebda64-96, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefebda64-96, col_values=(('qos', UUID('b465efa1-6a1f-4065-b469-79f8c3ddf843')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefebda64-96, col_values=(('external_ids', {'iface-id': 'efebda64-96d8-427d-b777-b43803cb2e92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:40:c0', 'vm-uuid': 'c75f05cb-4b25-4c55-81f6-4853a6ee4938'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: INFO os_vif [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96')
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81d5c23c-27, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81d5c23c-27, col_values=(('qos', UUID('4a4dfc9b-3207-4478-8b21-527dd630662e')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81d5c23c-27, col_values=(('external_ids', {'iface-id': '81d5c23c-2743-4ba8-a05f-a5c91722f552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:e1:18', 'vm-uuid': 'e5865b32-ff16-4409-9130-4ac985de81ca'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: INFO os_vif [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27')
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34cfacd-c6, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf34cfacd-c6, col_values=(('qos', UUID('ce2488c8-6819-4406-b63c-462e4a4cb5da')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf34cfacd-c6, col_values=(('external_ids', {'iface-id': 'f34cfacd-c6a0-40a5-894b-98b4c7c5cf47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:f2:d8', 'vm-uuid': 'fcc51f4f-7b46-4475-9cbf-53421eb0803f'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No VIF found with MAC fa:16:3e:73:d7:5d, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No VIF found with MAC fa:16:3e:12:40:c0, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:21 user nova-compute[75292]: INFO os_vif [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6')
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:67:e1:18, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:4d:f2:d8, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:25 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:25 user nova-compute[75292]: INFO nova.compute.claims [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Claim successful on node user
Nov 14 14:33:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.network.neutron [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Creating image(s)
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "/opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "/opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "/opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG nova.policy [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f6816e7810246f39c569b568d2be333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f3598b451430aa15c1f92e1c21aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.258s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk 1073741824" returned: 0 in 0.053s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.223s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Cannot resize image /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Ensure instance console log exists: /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:28 user nova-compute[75292]: DEBUG nova.network.neutron [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Successfully created port: 0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-477be992-7beb-4e56-b2d9-e9957d9d49b2 req-91e4ce08-1757-497e-804b-98fd71d24107 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-477be992-7beb-4e56-b2d9-e9957d9d49b2 req-91e4ce08-1757-497e-804b-98fd71d24107 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-477be992-7beb-4e56-b2d9-e9957d9d49b2 req-91e4ce08-1757-497e-804b-98fd71d24107 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-477be992-7beb-4e56-b2d9-e9957d9d49b2 req-91e4ce08-1757-497e-804b-98fd71d24107 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-477be992-7beb-4e56-b2d9-e9957d9d49b2 req-91e4ce08-1757-497e-804b-98fd71d24107 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:28 user nova-compute[75292]: WARNING nova.compute.manager [req-477be992-7beb-4e56-b2d9-e9957d9d49b2 req-91e4ce08-1757-497e-804b-98fd71d24107 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state building and task_state spawning.
Nov 14 14:33:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:29 user nova-compute[75292]: INFO nova.compute.claims [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Claim successful on node user
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.network.neutron [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Successfully updated port: 0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquired lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.network.neutron [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-changed-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Refreshing instance network info cache due to event network-changed-0113c6de-745c-4af7-8e3d-43ac3f4cba4e. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] Acquiring lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.network.neutron [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance spawned successfully.
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Instance spawned successfully.
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Took 17.25 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Took 19.38 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance spawned successfully.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance spawned successfully.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.compute.manager [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Took 18.61 seconds to build instance.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.compute.manager [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Took 20.97 seconds to build instance.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-078c9ea8-933f-4ca7-9e90-9e5f1893a4ef tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.816s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-285e5e18-8a02-4554-a8ff-dd15871850af tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.169s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-710296a1-48ae-4b46-abea-1acaf764851b req-14fc1cc0-1760-44bb-b182-9b8af10f27cd service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-710296a1-48ae-4b46-abea-1acaf764851b req-14fc1cc0-1760-44bb-b182-9b8af10f27cd service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-710296a1-48ae-4b46-abea-1acaf764851b req-14fc1cc0-1760-44bb-b182-9b8af10f27cd service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-710296a1-48ae-4b46-abea-1acaf764851b req-14fc1cc0-1760-44bb-b182-9b8af10f27cd service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-710296a1-48ae-4b46-abea-1acaf764851b req-14fc1cc0-1760-44bb-b182-9b8af10f27cd service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:30 user nova-compute[75292]: WARNING nova.compute.manager [req-710296a1-48ae-4b46-abea-1acaf764851b req-14fc1cc0-1760-44bb-b182-9b8af10f27cd service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state building and task_state spawning.
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Took 18.48 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Took 21.01 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Creating image(s)
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "/opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "/opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.062s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "8918aacdcb5dfdce0ba102a90e863bb98aace480" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "8918aacdcb5dfdce0ba102a90e863bb98aace480" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG nova.policy [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88810f441446408b872009324a873ed8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deac54b17f774b05ab6428bc8ade6d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:31 user nova-compute[75292]: INFO nova.compute.manager [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Took 19.42 seconds to build instance.
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b1448542-e261-47dd-a346-76138d77dfc4 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.576s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:31 user nova-compute[75292]: INFO nova.compute.manager [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Took 22.21 seconds to build instance.
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-97b6db72-319d-4ea1-8458-73a3a53942e8 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.448s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG nova.network.neutron [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updating instance_info_cache with network_info: [{"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.part --force-share --output=json" returned: 0 in 0.317s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG nova.virt.images [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] de803334-de11-4f75-880c-c289fa303b2f was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:33:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.part /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Releasing lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Instance network_info: |[{"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] Acquired lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Refreshing network info cache for port 0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Start _get_guest_xml network_info=[{"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:32 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:32 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1969466487',display_name='tempest-VolumesAdminNegativeTest-server-1969466487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1969466487',id=5,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq3EAzOxeViNmBmbGYU3fJkD5qlKZnSK6JjyMXD9eF1fYIVL2nFemnBD28opzEMBzHeq3CpNRzsyDkX653rvFsGCgebyI3Vi4d2/rMCw+lpoiZjfwwJ5oxDHE0Y3DPydQ==',key_name='tempest-keypair-1154101494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='892f3598b451430aa15c1f92e1c21aaa',ramdisk_id='',reservation_id='r-0nc7v9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1045564970',owner_user_name='tempest-VolumesAdminNegativeTest-1045564970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6816e7810246f39c569b568d2be333',uuid=44726e61-672d-42a1-81ae-489cb41dc49e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converting VIF {"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.objects.instance [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'pci_devices' on Instance uuid 44726e61-672d-42a1-81ae-489cb41dc49e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:32 user nova-compute[75292]:   <uuid>44726e61-672d-42a1-81ae-489cb41dc49e</uuid>
Nov 14 14:33:32 user nova-compute[75292]:   <name>instance-00000005</name>
Nov 14 14:33:32 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:32 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:32 user nova-compute[75292]:   <metadata>
Nov 14 14:33:32 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:32 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:32 user nova-compute[75292]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1969466487</nova:name>
Nov 14 14:33:32 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:32</nova:creationTime>
Nov 14 14:33:32 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:32 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:32 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:32 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:user uuid="1f6816e7810246f39c569b568d2be333">tempest-VolumesAdminNegativeTest-1045564970-project-member</nova:user>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:project uuid="892f3598b451430aa15c1f92e1c21aaa">tempest-VolumesAdminNegativeTest-1045564970</nova:project>
Nov 14 14:33:32 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:32 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:33:32 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:32 user nova-compute[75292]:         <nova:port uuid="0113c6de-745c-4af7-8e3d-43ac3f4cba4e">
Nov 14 14:33:32 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 14:33:32 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:32 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:32 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:32 user nova-compute[75292]:   </metadata>
Nov 14 14:33:32 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:32 user nova-compute[75292]:     <system>
Nov 14 14:33:32 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:32 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:32 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:32 user nova-compute[75292]:       <entry name="serial">44726e61-672d-42a1-81ae-489cb41dc49e</entry>
Nov 14 14:33:32 user nova-compute[75292]:       <entry name="uuid">44726e61-672d-42a1-81ae-489cb41dc49e</entry>
Nov 14 14:33:32 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:32 user nova-compute[75292]:     </system>
Nov 14 14:33:32 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:32 user nova-compute[75292]:   <os>
Nov 14 14:33:32 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:32 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:32 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:32 user nova-compute[75292]:   </os>
Nov 14 14:33:32 user nova-compute[75292]:   <features>
Nov 14 14:33:32 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:32 user nova-compute[75292]:     <apic/>
Nov 14 14:33:32 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:32 user nova-compute[75292]:   </features>
Nov 14 14:33:32 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:32 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:32 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:32 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:32 user nova-compute[75292]:   </clock>
Nov 14 14:33:32 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:32 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:32 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:32 user nova-compute[75292]:   </cpu>
Nov 14 14:33:32 user nova-compute[75292]:   <devices>
Nov 14 14:33:32 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:32 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:32 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk"/>
Nov 14 14:33:32 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:33:32 user nova-compute[75292]:     </disk>
Nov 14 14:33:32 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:32 user nova-compute[75292]:       <mac address="fa:16:3e:6f:07:d2"/>
Nov 14 14:33:32 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:32 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:32 user nova-compute[75292]:       <target dev="tap0113c6de-74"/>
Nov 14 14:33:32 user nova-compute[75292]:     </interface>
Nov 14 14:33:32 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:32 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/console.log" append="off"/>
Nov 14 14:33:32 user nova-compute[75292]:     </serial>
Nov 14 14:33:32 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:32 user nova-compute[75292]:     <video>
Nov 14 14:33:32 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:32 user nova-compute[75292]:     </video>
Nov 14 14:33:32 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:32 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:32 user nova-compute[75292]:     </rng>
Nov 14 14:33:32 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:32 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:32 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:32 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:32 user nova-compute[75292]:   </devices>
Nov 14 14:33:32 user nova-compute[75292]: </domain>
Nov 14 14:33:32 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1969466487',display_name='tempest-VolumesAdminNegativeTest-server-1969466487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1969466487',id=5,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq3EAzOxeViNmBmbGYU3fJkD5qlKZnSK6JjyMXD9eF1fYIVL2nFemnBD28opzEMBzHeq3CpNRzsyDkX653rvFsGCgebyI3Vi4d2/rMCw+lpoiZjfwwJ5oxDHE0Y3DPydQ==',key_name='tempest-keypair-1154101494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='892f3598b451430aa15c1f92e1c21aaa',ramdisk_id='',reservation_id='r-0nc7v9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1045564970',owner_user_name='tempest-VolumesAdminNegativeTest-1045564970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6816e7810246f39c569b568d2be333',uuid=44726e61-672d-42a1-81ae-489cb41dc49e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converting VIF {"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG os_vif [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2bed029-6b08-5bd7-ab33-79a628518210', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0113c6de-74, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0113c6de-74, col_values=(('qos', UUID('3f7a1841-7849-4f27-b54f-a338b3151bfe')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0113c6de-74, col_values=(('external_ids', {'iface-id': '0113c6de-745c-4af7-8e3d-43ac3f4cba4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:07:d2', 'vm-uuid': '44726e61-672d-42a1-81ae-489cb41dc49e'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:32 user nova-compute[75292]: INFO os_vif [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74')
Nov 14 14:33:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.part /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.converted" returned: 0 in 0.736s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No VIF found with MAC fa:16:3e:6f:07:d2, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480.converted --force-share --output=json" returned: 0 in 0.413s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "8918aacdcb5dfdce0ba102a90e863bb98aace480" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.078s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 --force-share --output=json" returned: 0 in 0.312s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "8918aacdcb5dfdce0ba102a90e863bb98aace480" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "8918aacdcb5dfdce0ba102a90e863bb98aace480" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Successfully created port: b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 --force-share --output=json" returned: 0 in 0.210s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480,backing_fmt=raw /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480,backing_fmt=raw /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk 1073741824" returned: 0 in 0.070s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "8918aacdcb5dfdce0ba102a90e863bb98aace480" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 --force-share --output=json" returned: 0 in 0.252s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Cannot resize image /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Ensure instance console log exists: /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updated VIF entry in instance network info cache for port 0113c6de-745c-4af7-8e3d-43ac3f4cba4e. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updating instance_info_cache with network_info: [{"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d53486c4-1dbd-4fe1-891b-a72c420dae55 req-66c2cb1f-dd2e-43b9-820b-b944c7749051 service nova] Releasing lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:35 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:35 user nova-compute[75292]: INFO nova.compute.claims [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Claim successful on node user
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Successfully updated port: b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquired lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-changed-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Refreshing instance network info cache due to event network-changed-b3808b25-fd92-4056-9613-50163da2a577. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] Acquiring lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.975s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Creating image(s)
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "/opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "/opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "/opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.policy [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6050224dba22476d9acf79d57adbab7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a53f2f79e03f48f684cfa39c515c154d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.500s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updating instance_info_cache with network_info: [{"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Releasing lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Instance network_info: |[{"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] Acquired lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Refreshing network info cache for port b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Start _get_guest_xml network_info=[{"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:33:21Z,direct_url=<?>,disk_format='qcow2',id=de803334-de11-4f75-880c-c289fa303b2f,min_disk=0,min_ram=0,name='',owner='c60ac4116afa4d558c54603d03b6cd2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:33:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'image_id': 'de803334-de11-4f75-880c-c289fa303b2f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Instance spawned successfully.
Nov 14 14:33:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.247s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:38 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk 1073741824" returned: 0 in 0.151s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.406s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:33:21Z,direct_url=<?>,disk_format='qcow2',id=de803334-de11-4f75-880c-c289fa303b2f,min_disk=0,min_ram=0,name='',owner='c60ac4116afa4d558c54603d03b6cd2c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:33:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1968437455',display_name='tempest-AttachSCSIVolumeTestJSON-server-1968437455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1968437455',id=6,image_ref='de803334-de11-4f75-880c-c289fa303b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHNLCpTmZAOMxw3MwCoS0DrHsavtwl+DcTDhLMPLQMt6V3ThKGEyLA68ZCFRI3tRf/6UnGC17wuSsDCdnqF8zk+7GbBGfCHmeYJLr6T53HnyEerk3ufRt+ScJTVfO3fAw==',key_name='tempest-keypair-46169738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deac54b17f774b05ab6428bc8ade6d93',ramdisk_id='',reservation_id='r-ln0cxsq5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='de803334-de11-4f75-880c-c289fa303b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-733040432',owner_user_name='tempest-AttachSCSIVolumeTestJSON-733040432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88810f441446408b872009324a873ed8',uuid=2f019191-1147-4e62-8680-3a6cd7fcfe78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Converting VIF {"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f019191-1147-4e62-8680-3a6cd7fcfe78 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:38 user nova-compute[75292]: INFO nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Took 11.56 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:38 user nova-compute[75292]:   <uuid>2f019191-1147-4e62-8680-3a6cd7fcfe78</uuid>
Nov 14 14:33:38 user nova-compute[75292]:   <name>instance-00000006</name>
Nov 14 14:33:38 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:38 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:38 user nova-compute[75292]:   <metadata>
Nov 14 14:33:38 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:38 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:38 user nova-compute[75292]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1968437455</nova:name>
Nov 14 14:33:38 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:38</nova:creationTime>
Nov 14 14:33:38 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:38 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:38 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:38 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:user uuid="88810f441446408b872009324a873ed8">tempest-AttachSCSIVolumeTestJSON-733040432-project-member</nova:user>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:project uuid="deac54b17f774b05ab6428bc8ade6d93">tempest-AttachSCSIVolumeTestJSON-733040432</nova:project>
Nov 14 14:33:38 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:38 user nova-compute[75292]:       <nova:root type="image" uuid="de803334-de11-4f75-880c-c289fa303b2f"/>
Nov 14 14:33:38 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:38 user nova-compute[75292]:         <nova:port uuid="b3808b25-fd92-4056-9613-50163da2a577">
Nov 14 14:33:38 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 14:33:38 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:38 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:38 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:38 user nova-compute[75292]:   </metadata>
Nov 14 14:33:38 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:38 user nova-compute[75292]:     <system>
Nov 14 14:33:38 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:38 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:38 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:38 user nova-compute[75292]:       <entry name="serial">2f019191-1147-4e62-8680-3a6cd7fcfe78</entry>
Nov 14 14:33:38 user nova-compute[75292]:       <entry name="uuid">2f019191-1147-4e62-8680-3a6cd7fcfe78</entry>
Nov 14 14:33:38 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:38 user nova-compute[75292]:     </system>
Nov 14 14:33:38 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:38 user nova-compute[75292]:   <os>
Nov 14 14:33:38 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:38 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:38 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:38 user nova-compute[75292]:   </os>
Nov 14 14:33:38 user nova-compute[75292]:   <features>
Nov 14 14:33:38 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:38 user nova-compute[75292]:     <apic/>
Nov 14 14:33:38 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:38 user nova-compute[75292]:   </features>
Nov 14 14:33:38 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:38 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:38 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:38 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:38 user nova-compute[75292]:   </clock>
Nov 14 14:33:38 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:38 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:38 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:38 user nova-compute[75292]:   </cpu>
Nov 14 14:33:38 user nova-compute[75292]:   <devices>
Nov 14 14:33:38 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:38 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:38 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk"/>
Nov 14 14:33:38 user nova-compute[75292]:       <target dev="sda" bus="scsi"/>
Nov 14 14:33:38 user nova-compute[75292]:       <address type="drive" controller="0" unit="0"/>
Nov 14 14:33:38 user nova-compute[75292]:     </disk>
Nov 14 14:33:38 user nova-compute[75292]:     <disk type="file" device="cdrom">
Nov 14 14:33:38 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 14:33:38 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.config"/>
Nov 14 14:33:38 user nova-compute[75292]:       <target dev="sdb" bus="scsi"/>
Nov 14 14:33:38 user nova-compute[75292]:       <address type="drive" controller="0" unit="1"/>
Nov 14 14:33:38 user nova-compute[75292]:     </disk>
Nov 14 14:33:38 user nova-compute[75292]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 14:33:38 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:38 user nova-compute[75292]:       <mac address="fa:16:3e:77:d3:81"/>
Nov 14 14:33:38 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:38 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:38 user nova-compute[75292]:       <target dev="tapb3808b25-fd"/>
Nov 14 14:33:38 user nova-compute[75292]:     </interface>
Nov 14 14:33:38 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:38 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/console.log" append="off"/>
Nov 14 14:33:38 user nova-compute[75292]:     </serial>
Nov 14 14:33:38 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:38 user nova-compute[75292]:     <video>
Nov 14 14:33:38 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:38 user nova-compute[75292]:     </video>
Nov 14 14:33:38 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:38 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:38 user nova-compute[75292]:     </rng>
Nov 14 14:33:38 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:38 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:38 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:38 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:38 user nova-compute[75292]:   </devices>
Nov 14 14:33:38 user nova-compute[75292]: </domain>
Nov 14 14:33:38 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1968437455',display_name='tempest-AttachSCSIVolumeTestJSON-server-1968437455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1968437455',id=6,image_ref='de803334-de11-4f75-880c-c289fa303b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHNLCpTmZAOMxw3MwCoS0DrHsavtwl+DcTDhLMPLQMt6V3ThKGEyLA68ZCFRI3tRf/6UnGC17wuSsDCdnqF8zk+7GbBGfCHmeYJLr6T53HnyEerk3ufRt+ScJTVfO3fAw==',key_name='tempest-keypair-46169738',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='deac54b17f774b05ab6428bc8ade6d93',ramdisk_id='',reservation_id='r-ln0cxsq5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='de803334-de11-4f75-880c-c289fa303b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-733040432',owner_user_name='tempest-AttachSCSIVolumeTestJSON-733040432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88810f441446408b872009324a873ed8',uuid=2f019191-1147-4e62-8680-3a6cd7fcfe78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Converting VIF {"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG os_vif [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79b8c5f4-ed91-5f44-88c5-ffcf9e4af5e4', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3808b25-fd, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3808b25-fd, col_values=(('qos', UUID('35ebc928-f132-4aaa-97d9-397c1f0dbc35')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3808b25-fd, col_values=(('external_ids', {'iface-id': 'b3808b25-fd92-4056-9613-50163da2a577', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:d3:81', 'vm-uuid': '2f019191-1147-4e62-8680-3a6cd7fcfe78'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: INFO os_vif [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd')
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.416s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:38 user nova-compute[75292]: INFO nova.compute.manager [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Took 12.73 seconds to build instance.
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No BDM found with device name sda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No VIF found with MAC fa:16:3e:77:d3:81, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:38 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Using config drive
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-30d79a8a-7ac0-4f56-8f36-20be1a86ecc8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.132s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Cannot resize image /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Ensure instance console log exists: /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:39 user nova-compute[75292]: DEBUG nova.network.neutron [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updated VIF entry in instance network info cache for port b3808b25-fd92-4056-9613-50163da2a577. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:39 user nova-compute[75292]: DEBUG nova.network.neutron [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updating instance_info_cache with network_info: [{"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ebb097d-c4f2-4b42-89ad-b4b419a91371 req-d998ba14-ed9f-4432-b157-37dd0da473c5 service nova] Releasing lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:40 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Successfully created port: cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Creating config drive at /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.config
Nov 14 14:33:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfpn6316t {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfpn6316t" returned: 0 in 0.054s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Successfully updated port: cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquired lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-changed-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Refreshing instance network info cache due to event network-changed-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] Acquiring lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updating instance_info_cache with network_info: [{"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Releasing lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Instance network_info: |[{"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] Acquired lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Refreshing network info cache for port cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:33:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Start _get_guest_xml network_info=[{"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:33:44 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:44 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2060622894',display_name='tempest-TestVolumeSwap-server-2060622894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2060622894',id=7,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCFrTWF15toPmexPh17cmowT8Ewg/Tnv6QHOiG6wF7cBwb5gLdmVzqXYz293O8lpgxeUPhHUJc2tscz7l87mGGXwdnOkLrdZBwG+mplSaw33hTRpC3qmhf9tpXrmVzrdg==',key_name='tempest-keypair-2037972140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a53f2f79e03f48f684cfa39c515c154d',ramdisk_id='',reservation_id='r-z06kebhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-792431185',owner_user_name='tempest-TestVolumeSwap-792431185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6050224dba22476d9acf79d57adbab7f',uuid=092131de-273a-4410-bc2e-84f02a3e081f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Converting VIF {"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lazy-loading 'pci_devices' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:33:44 user nova-compute[75292]:   <uuid>092131de-273a-4410-bc2e-84f02a3e081f</uuid>
Nov 14 14:33:44 user nova-compute[75292]:   <name>instance-00000007</name>
Nov 14 14:33:44 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:33:44 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:33:44 user nova-compute[75292]:   <metadata>
Nov 14 14:33:44 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:33:44 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:33:44 user nova-compute[75292]:       <nova:name>tempest-TestVolumeSwap-server-2060622894</nova:name>
Nov 14 14:33:44 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:33:44</nova:creationTime>
Nov 14 14:33:44 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:33:44 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:33:44 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:33:44 user nova-compute[75292]:       <nova:owner>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:user uuid="6050224dba22476d9acf79d57adbab7f">tempest-TestVolumeSwap-792431185-project-member</nova:user>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:project uuid="a53f2f79e03f48f684cfa39c515c154d">tempest-TestVolumeSwap-792431185</nova:project>
Nov 14 14:33:44 user nova-compute[75292]:       </nova:owner>
Nov 14 14:33:44 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:33:44 user nova-compute[75292]:       <nova:ports>
Nov 14 14:33:44 user nova-compute[75292]:         <nova:port uuid="cbb45e39-31ab-4b6d-a3d8-2fd7337c6099">
Nov 14 14:33:44 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 14:33:44 user nova-compute[75292]:         </nova:port>
Nov 14 14:33:44 user nova-compute[75292]:       </nova:ports>
Nov 14 14:33:44 user nova-compute[75292]:     </nova:instance>
Nov 14 14:33:44 user nova-compute[75292]:   </metadata>
Nov 14 14:33:44 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:33:44 user nova-compute[75292]:     <system>
Nov 14 14:33:44 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:33:44 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:33:44 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:33:44 user nova-compute[75292]:       <entry name="serial">092131de-273a-4410-bc2e-84f02a3e081f</entry>
Nov 14 14:33:44 user nova-compute[75292]:       <entry name="uuid">092131de-273a-4410-bc2e-84f02a3e081f</entry>
Nov 14 14:33:44 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:33:44 user nova-compute[75292]:     </system>
Nov 14 14:33:44 user nova-compute[75292]:   </sysinfo>
Nov 14 14:33:44 user nova-compute[75292]:   <os>
Nov 14 14:33:44 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:33:44 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:33:44 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:33:44 user nova-compute[75292]:   </os>
Nov 14 14:33:44 user nova-compute[75292]:   <features>
Nov 14 14:33:44 user nova-compute[75292]:     <acpi/>
Nov 14 14:33:44 user nova-compute[75292]:     <apic/>
Nov 14 14:33:44 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:33:44 user nova-compute[75292]:   </features>
Nov 14 14:33:44 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:33:44 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:33:44 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:33:44 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:33:44 user nova-compute[75292]:   </clock>
Nov 14 14:33:44 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:33:44 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:33:44 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:33:44 user nova-compute[75292]:   </cpu>
Nov 14 14:33:44 user nova-compute[75292]:   <devices>
Nov 14 14:33:44 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:33:44 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:33:44 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk"/>
Nov 14 14:33:44 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:33:44 user nova-compute[75292]:     </disk>
Nov 14 14:33:44 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:33:44 user nova-compute[75292]:       <mac address="fa:16:3e:6c:0b:33"/>
Nov 14 14:33:44 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:44 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:33:44 user nova-compute[75292]:       <target dev="tapcbb45e39-31"/>
Nov 14 14:33:44 user nova-compute[75292]:     </interface>
Nov 14 14:33:44 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:33:44 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/console.log" append="off"/>
Nov 14 14:33:44 user nova-compute[75292]:     </serial>
Nov 14 14:33:44 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:33:44 user nova-compute[75292]:     <video>
Nov 14 14:33:44 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:33:44 user nova-compute[75292]:     </video>
Nov 14 14:33:44 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:33:44 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:33:44 user nova-compute[75292]:     </rng>
Nov 14 14:33:44 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:33:44 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:33:44 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:33:44 user nova-compute[75292]:     </memballoon>
Nov 14 14:33:44 user nova-compute[75292]:   </devices>
Nov 14 14:33:44 user nova-compute[75292]: </domain>
Nov 14 14:33:44 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2060622894',display_name='tempest-TestVolumeSwap-server-2060622894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2060622894',id=7,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCFrTWF15toPmexPh17cmowT8Ewg/Tnv6QHOiG6wF7cBwb5gLdmVzqXYz293O8lpgxeUPhHUJc2tscz7l87mGGXwdnOkLrdZBwG+mplSaw33hTRpC3qmhf9tpXrmVzrdg==',key_name='tempest-keypair-2037972140',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a53f2f79e03f48f684cfa39c515c154d',ramdisk_id='',reservation_id='r-z06kebhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-792431185',owner_user_name='tempest-TestVolumeSwap-792431185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6050224dba22476d9acf79d57adbab7f',uuid=092131de-273a-4410-bc2e-84f02a3e081f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Converting VIF {"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG os_vif [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce156b53-7a96-583b-b995-803e35d4120a', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbb45e39-31, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbb45e39-31, col_values=(('qos', UUID('82ff3fda-0dba-4b67-afe8-67efd43c3e73')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbb45e39-31, col_values=(('external_ids', {'iface-id': 'cbb45e39-31ab-4b6d-a3d8-2fd7337c6099', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:0b:33', 'vm-uuid': '092131de-273a-4410-bc2e-84f02a3e081f'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:44 user nova-compute[75292]: INFO os_vif [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31')
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] No VIF found with MAC fa:16:3e:6c:0b:33, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.network.neutron [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updated VIF entry in instance network info cache for port cbb45e39-31ab-4b6d-a3d8-2fd7337c6099. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:33:44 user nova-compute[75292]: DEBUG nova.network.neutron [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updating instance_info_cache with network_info: [{"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b36235ce-2c96-48c3-88f8-aa4acab64074 req-d4a80850-dde3-46ee-899b-65ab832e74d6 service nova] Releasing lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-6d2e2189-b787-4c38-abab-8f0d5d2a74f6 req-37a264e9-09bf-4713-999b-f16bef9e4b2f service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6d2e2189-b787-4c38-abab-8f0d5d2a74f6 req-37a264e9-09bf-4713-999b-f16bef9e4b2f service nova] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6d2e2189-b787-4c38-abab-8f0d5d2a74f6 req-37a264e9-09bf-4713-999b-f16bef9e4b2f service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6d2e2189-b787-4c38-abab-8f0d5d2a74f6 req-37a264e9-09bf-4713-999b-f16bef9e4b2f service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-6d2e2189-b787-4c38-abab-8f0d5d2a74f6 req-37a264e9-09bf-4713-999b-f16bef9e4b2f service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] No waiting events found dispatching network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:45 user nova-compute[75292]: WARNING nova.compute.manager [req-6d2e2189-b787-4c38-abab-8f0d5d2a74f6 req-37a264e9-09bf-4713-999b-f16bef9e4b2f service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received unexpected event network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 for instance with vm_state building and task_state spawning.
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Instance spawned successfully.
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:45 user nova-compute[75292]: INFO nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Took 14.77 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-d8ee23a5-9fec-4546-8c71-c2acce60561c req-96681228-4c9d-433d-9682-bd060544262e service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8ee23a5-9fec-4546-8c71-c2acce60561c req-96681228-4c9d-433d-9682-bd060544262e service nova] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8ee23a5-9fec-4546-8c71-c2acce60561c req-96681228-4c9d-433d-9682-bd060544262e service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8ee23a5-9fec-4546-8c71-c2acce60561c req-96681228-4c9d-433d-9682-bd060544262e service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-d8ee23a5-9fec-4546-8c71-c2acce60561c req-96681228-4c9d-433d-9682-bd060544262e service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] No waiting events found dispatching network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:45 user nova-compute[75292]: WARNING nova.compute.manager [req-d8ee23a5-9fec-4546-8c71-c2acce60561c req-96681228-4c9d-433d-9682-bd060544262e service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received unexpected event network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 for instance with vm_state active and task_state None.
Nov 14 14:33:45 user nova-compute[75292]: INFO nova.compute.manager [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Took 16.41 seconds to build instance.
Nov 14 14:33:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ee407814-d9c3-458b-8848-6117fce5f434 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.642s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-b2fdb890-57de-4274-965b-04773e1d89f1 req-d6a7343c-cbb7-4e55-9458-60c8a1ccf51a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b2fdb890-57de-4274-965b-04773e1d89f1 req-d6a7343c-cbb7-4e55-9458-60c8a1ccf51a service nova] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b2fdb890-57de-4274-965b-04773e1d89f1 req-d6a7343c-cbb7-4e55-9458-60c8a1ccf51a service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b2fdb890-57de-4274-965b-04773e1d89f1 req-d6a7343c-cbb7-4e55-9458-60c8a1ccf51a service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-b2fdb890-57de-4274-965b-04773e1d89f1 req-d6a7343c-cbb7-4e55-9458-60c8a1ccf51a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] No waiting events found dispatching network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:47 user nova-compute[75292]: WARNING nova.compute.manager [req-b2fdb890-57de-4274-965b-04773e1d89f1 req-d6a7343c-cbb7-4e55-9458-60c8a1ccf51a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received unexpected event network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 for instance with vm_state active and task_state None.
Nov 14 14:33:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] No waiting events found dispatching network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:48 user nova-compute[75292]: WARNING nova.compute.manager [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received unexpected event network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 for instance with vm_state active and task_state None.
Nov 14 14:33:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] No waiting events found dispatching network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:48 user nova-compute[75292]: WARNING nova.compute.manager [req-f322f880-efab-4707-b3ea-28de3bdcaab9 req-f9d18482-7f80-462d-a864-4ab1196f9b9e service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received unexpected event network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e for instance with vm_state active and task_state None.
Nov 14 14:33:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:33:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Instance spawned successfully.
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:33:50 user nova-compute[75292]: INFO nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Took 12.94 seconds to spawn the instance on the hypervisor.
Nov 14 14:33:50 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:33:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea3a8dee-e58b-4413-9f32-76bfd93fd512 req-c7f3a3f3-94fe-49aa-8ff9-37e7021664b6 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea3a8dee-e58b-4413-9f32-76bfd93fd512 req-c7f3a3f3-94fe-49aa-8ff9-37e7021664b6 service nova] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea3a8dee-e58b-4413-9f32-76bfd93fd512 req-c7f3a3f3-94fe-49aa-8ff9-37e7021664b6 service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea3a8dee-e58b-4413-9f32-76bfd93fd512 req-c7f3a3f3-94fe-49aa-8ff9-37e7021664b6 service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea3a8dee-e58b-4413-9f32-76bfd93fd512 req-c7f3a3f3-94fe-49aa-8ff9-37e7021664b6 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] No waiting events found dispatching network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:50 user nova-compute[75292]: WARNING nova.compute.manager [req-ea3a8dee-e58b-4413-9f32-76bfd93fd512 req-c7f3a3f3-94fe-49aa-8ff9-37e7021664b6 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received unexpected event network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e for instance with vm_state active and task_state None.
Nov 14 14:33:50 user nova-compute[75292]: INFO nova.compute.manager [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Took 14.51 seconds to build instance.
Nov 14 14:33:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d7f8392b-7660-40b2-8eb4-3337eb81b623 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.692s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:52 user nova-compute[75292]: INFO nova.compute.claims [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Claim successful on node user
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "77551ead-0c38-454e-b6a6-aee54129ae69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.041s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:33:52 user nova-compute[75292]: INFO nova.compute.claims [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Claim successful on node user
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.policy [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e012eb20d3a747839438c163a6ef5318', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64b2adb8bc44cc4ab90960aff1eeb7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Creating image(s)
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "/opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "/opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "/opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.238s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.775s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.267s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk 1073741824" returned: 0 in 0.069s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:33:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Creating image(s)
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "/opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "/opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "/opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.195s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Cannot resize image /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Ensure instance console log exists: /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.policy [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6631dc16c35e4f2b990ee0c9447eaea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae397a90f122425485c3b2dd48c4a83b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk 1073741824" returned: 0 in 0.065s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.204s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Cannot resize image /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Ensure instance console log exists: /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Successfully created port: 1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-3505b4e6-f70b-48ff-bc90-c9865839e228 req-9aae11da-ca16-488e-8170-66ca1848b75a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3505b4e6-f70b-48ff-bc90-c9865839e228 req-9aae11da-ca16-488e-8170-66ca1848b75a service nova] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3505b4e6-f70b-48ff-bc90-c9865839e228 req-9aae11da-ca16-488e-8170-66ca1848b75a service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3505b4e6-f70b-48ff-bc90-c9865839e228 req-9aae11da-ca16-488e-8170-66ca1848b75a service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-3505b4e6-f70b-48ff-bc90-c9865839e228 req-9aae11da-ca16-488e-8170-66ca1848b75a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] No waiting events found dispatching network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:55 user nova-compute[75292]: WARNING nova.compute.manager [req-3505b4e6-f70b-48ff-bc90-c9865839e228 req-9aae11da-ca16-488e-8170-66ca1848b75a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received unexpected event network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 for instance with vm_state active and task_state None.
Nov 14 14:33:56 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Successfully created port: cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:33:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-12e0592e-7e29-4e4e-a41d-3253e4012a82 req-a72c34da-8908-4859-9316-9fcde77a13c3 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-12e0592e-7e29-4e4e-a41d-3253e4012a82 req-a72c34da-8908-4859-9316-9fcde77a13c3 service nova] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:33:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-12e0592e-7e29-4e4e-a41d-3253e4012a82 req-a72c34da-8908-4859-9316-9fcde77a13c3 service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:33:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-12e0592e-7e29-4e4e-a41d-3253e4012a82 req-a72c34da-8908-4859-9316-9fcde77a13c3 service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:33:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-12e0592e-7e29-4e4e-a41d-3253e4012a82 req-a72c34da-8908-4859-9316-9fcde77a13c3 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] No waiting events found dispatching network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:33:57 user nova-compute[75292]: WARNING nova.compute.manager [req-12e0592e-7e29-4e4e-a41d-3253e4012a82 req-a72c34da-8908-4859-9316-9fcde77a13c3 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received unexpected event network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 for instance with vm_state active and task_state None.
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Successfully updated port: 1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquired lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-changed-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Refreshing instance network info cache due to event network-changed-1c3fced5-ac28-4e27-9f2f-86082ab39b03. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] Acquiring lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 14:33:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:33:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:33:59 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updating instance_info_cache with network_info: [{"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Releasing lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Instance network_info: |[{"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] Acquired lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.neutron [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Refreshing network info cache for port 1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Start _get_guest_xml network_info=[{"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:34:00 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:00 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-811718922',display_name='tempest-VolumesAssistedSnapshotsTest-server-811718922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-811718922',id=8,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPQFb4y0STltrofecsFNboiEiBFT7OtqCTmZp2lhQ82QVhSq8B7T3zCjqCMpfBTv817arS4whEz+LzQpxBJBkcxpjHKpYm8fs92wU7fThZVOmUjjp9MV6mzUunqKrjhkg==',key_name='tempest-keypair-993343820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64b2adb8bc44cc4ab90960aff1eeb7b',ramdisk_id='',reservation_id='r-zl8ahy0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1243454398',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1243454398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e012eb20d3a747839438c163a6ef5318',uuid=d840933b-733f-435d-93cc-d83afd5e2eaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Converting VIF {"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lazy-loading 'pci_devices' on Instance uuid d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Successfully updated port: cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:34:00 user nova-compute[75292]:   <uuid>d840933b-733f-435d-93cc-d83afd5e2eaa</uuid>
Nov 14 14:34:00 user nova-compute[75292]:   <name>instance-00000008</name>
Nov 14 14:34:00 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:34:00 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:34:00 user nova-compute[75292]:   <metadata>
Nov 14 14:34:00 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:34:00 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:34:00 user nova-compute[75292]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-811718922</nova:name>
Nov 14 14:34:00 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:34:00</nova:creationTime>
Nov 14 14:34:00 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:34:00 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:34:00 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:34:00 user nova-compute[75292]:       <nova:owner>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:user uuid="e012eb20d3a747839438c163a6ef5318">tempest-VolumesAssistedSnapshotsTest-1243454398-project-member</nova:user>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:project uuid="d64b2adb8bc44cc4ab90960aff1eeb7b">tempest-VolumesAssistedSnapshotsTest-1243454398</nova:project>
Nov 14 14:34:00 user nova-compute[75292]:       </nova:owner>
Nov 14 14:34:00 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:34:00 user nova-compute[75292]:       <nova:ports>
Nov 14 14:34:00 user nova-compute[75292]:         <nova:port uuid="1c3fced5-ac28-4e27-9f2f-86082ab39b03">
Nov 14 14:34:00 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:34:00 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:00 user nova-compute[75292]:       </nova:ports>
Nov 14 14:34:00 user nova-compute[75292]:     </nova:instance>
Nov 14 14:34:00 user nova-compute[75292]:   </metadata>
Nov 14 14:34:00 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:34:00 user nova-compute[75292]:     <system>
Nov 14 14:34:00 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:34:00 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:34:00 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:34:00 user nova-compute[75292]:       <entry name="serial">d840933b-733f-435d-93cc-d83afd5e2eaa</entry>
Nov 14 14:34:00 user nova-compute[75292]:       <entry name="uuid">d840933b-733f-435d-93cc-d83afd5e2eaa</entry>
Nov 14 14:34:00 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:34:00 user nova-compute[75292]:     </system>
Nov 14 14:34:00 user nova-compute[75292]:   </sysinfo>
Nov 14 14:34:00 user nova-compute[75292]:   <os>
Nov 14 14:34:00 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:34:00 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:34:00 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:34:00 user nova-compute[75292]:   </os>
Nov 14 14:34:00 user nova-compute[75292]:   <features>
Nov 14 14:34:00 user nova-compute[75292]:     <acpi/>
Nov 14 14:34:00 user nova-compute[75292]:     <apic/>
Nov 14 14:34:00 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:34:00 user nova-compute[75292]:   </features>
Nov 14 14:34:00 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:34:00 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:34:00 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:34:00 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:34:00 user nova-compute[75292]:   </clock>
Nov 14 14:34:00 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:34:00 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:34:00 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:34:00 user nova-compute[75292]:   </cpu>
Nov 14 14:34:00 user nova-compute[75292]:   <devices>
Nov 14 14:34:00 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:34:00 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:34:00 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk"/>
Nov 14 14:34:00 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:34:00 user nova-compute[75292]:     </disk>
Nov 14 14:34:00 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:00 user nova-compute[75292]:       <mac address="fa:16:3e:2c:47:a9"/>
Nov 14 14:34:00 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:00 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:00 user nova-compute[75292]:       <target dev="tap1c3fced5-ac"/>
Nov 14 14:34:00 user nova-compute[75292]:     </interface>
Nov 14 14:34:00 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:34:00 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/console.log" append="off"/>
Nov 14 14:34:00 user nova-compute[75292]:     </serial>
Nov 14 14:34:00 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:34:00 user nova-compute[75292]:     <video>
Nov 14 14:34:00 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:00 user nova-compute[75292]:     </video>
Nov 14 14:34:00 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:34:00 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:34:00 user nova-compute[75292]:     </rng>
Nov 14 14:34:00 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:34:00 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:34:00 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:34:00 user nova-compute[75292]:     </memballoon>
Nov 14 14:34:00 user nova-compute[75292]:   </devices>
Nov 14 14:34:00 user nova-compute[75292]: </domain>
Nov 14 14:34:00 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-811718922',display_name='tempest-VolumesAssistedSnapshotsTest-server-811718922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-811718922',id=8,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPQFb4y0STltrofecsFNboiEiBFT7OtqCTmZp2lhQ82QVhSq8B7T3zCjqCMpfBTv817arS4whEz+LzQpxBJBkcxpjHKpYm8fs92wU7fThZVOmUjjp9MV6mzUunqKrjhkg==',key_name='tempest-keypair-993343820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d64b2adb8bc44cc4ab90960aff1eeb7b',ramdisk_id='',reservation_id='r-zl8ahy0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1243454398',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1243454398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e012eb20d3a747839438c163a6ef5318',uuid=d840933b-733f-435d-93cc-d83afd5e2eaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Converting VIF {"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG os_vif [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a25f8c7-2e44-52ee-b0ec-696fe9b9eb92', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c3fced5-ac, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c3fced5-ac, col_values=(('qos', UUID('e8b7de22-b270-4fb2-893e-397cf612710d')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c3fced5-ac, col_values=(('external_ids', {'iface-id': '1c3fced5-ac28-4e27-9f2f-86082ab39b03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:47:a9', 'vm-uuid': 'd840933b-733f-435d-93cc-d83afd5e2eaa'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:00 user nova-compute[75292]: INFO os_vif [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac')
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "refresh_cache-77551ead-0c38-454e-b6a6-aee54129ae69" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquired lock "refresh_cache-77551ead-0c38-454e-b6a6-aee54129ae69" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] No VIF found with MAC fa:16:3e:2c:47:a9, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-changed-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Refreshing instance network info cache due to event network-changed-cc05278a-0ff3-4def-b0d8-70fb7aa7890d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] Acquiring lock "refresh_cache-77551ead-0c38-454e-b6a6-aee54129ae69" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:34:00 user nova-compute[75292]: INFO nova.compute.claims [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Claim successful on node user
Nov 14 14:34:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 14:34:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:34:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Updating instance_info_cache with network_info: [{"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Releasing lock "refresh_cache-77551ead-0c38-454e-b6a6-aee54129ae69" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Instance network_info: |[{"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updated VIF entry in instance network info cache for port 1c3fced5-ac28-4e27-9f2f-86082ab39b03. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updating instance_info_cache with network_info: [{"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] Acquired lock "refresh_cache-77551ead-0c38-454e-b6a6-aee54129ae69" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Refreshing network info cache for port cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Start _get_guest_xml network_info=[{"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5ba1e4d-73cf-4a61-8f56-7719ab8c967f req-25541ecc-2922-4823-8429-967a9b32b2da service nova] Releasing lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1580665728',display_name='tempest-VolumesActionsTest-instance-1580665728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1580665728',id=9,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae397a90f122425485c3b2dd48c4a83b',ramdisk_id='',reservation_id='r-0l67g1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-52200633',owner_user_name='tempest-VolumesActionsTest-52200633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:54Z,user_data=None,user_id='6631dc16c35e4f2b990ee0c9447eaea6',uuid=77551ead-0c38-454e-b6a6-aee54129ae69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Converting VIF {"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lazy-loading 'pci_devices' on Instance uuid 77551ead-0c38-454e-b6a6-aee54129ae69 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:34:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Creating image(s)
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "/opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "/opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:34:01 user nova-compute[75292]:   <uuid>77551ead-0c38-454e-b6a6-aee54129ae69</uuid>
Nov 14 14:34:01 user nova-compute[75292]:   <name>instance-00000009</name>
Nov 14 14:34:01 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:34:01 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:34:01 user nova-compute[75292]:   <metadata>
Nov 14 14:34:01 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:34:01 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:34:01 user nova-compute[75292]:       <nova:name>tempest-VolumesActionsTest-instance-1580665728</nova:name>
Nov 14 14:34:01 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:34:01</nova:creationTime>
Nov 14 14:34:01 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:34:01 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:34:01 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:34:01 user nova-compute[75292]:       <nova:owner>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:user uuid="6631dc16c35e4f2b990ee0c9447eaea6">tempest-VolumesActionsTest-52200633-project-member</nova:user>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:project uuid="ae397a90f122425485c3b2dd48c4a83b">tempest-VolumesActionsTest-52200633</nova:project>
Nov 14 14:34:01 user nova-compute[75292]:       </nova:owner>
Nov 14 14:34:01 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:34:01 user nova-compute[75292]:       <nova:ports>
Nov 14 14:34:01 user nova-compute[75292]:         <nova:port uuid="cc05278a-0ff3-4def-b0d8-70fb7aa7890d">
Nov 14 14:34:01 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:34:01 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:01 user nova-compute[75292]:       </nova:ports>
Nov 14 14:34:01 user nova-compute[75292]:     </nova:instance>
Nov 14 14:34:01 user nova-compute[75292]:   </metadata>
Nov 14 14:34:01 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:34:01 user nova-compute[75292]:     <system>
Nov 14 14:34:01 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:34:01 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:34:01 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:34:01 user nova-compute[75292]:       <entry name="serial">77551ead-0c38-454e-b6a6-aee54129ae69</entry>
Nov 14 14:34:01 user nova-compute[75292]:       <entry name="uuid">77551ead-0c38-454e-b6a6-aee54129ae69</entry>
Nov 14 14:34:01 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:34:01 user nova-compute[75292]:     </system>
Nov 14 14:34:01 user nova-compute[75292]:   </sysinfo>
Nov 14 14:34:01 user nova-compute[75292]:   <os>
Nov 14 14:34:01 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:34:01 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:34:01 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:34:01 user nova-compute[75292]:   </os>
Nov 14 14:34:01 user nova-compute[75292]:   <features>
Nov 14 14:34:01 user nova-compute[75292]:     <acpi/>
Nov 14 14:34:01 user nova-compute[75292]:     <apic/>
Nov 14 14:34:01 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:34:01 user nova-compute[75292]:   </features>
Nov 14 14:34:01 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:34:01 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:34:01 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:34:01 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:34:01 user nova-compute[75292]:   </clock>
Nov 14 14:34:01 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:34:01 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:34:01 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:34:01 user nova-compute[75292]:   </cpu>
Nov 14 14:34:01 user nova-compute[75292]:   <devices>
Nov 14 14:34:01 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:34:01 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:34:01 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk"/>
Nov 14 14:34:01 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:34:01 user nova-compute[75292]:     </disk>
Nov 14 14:34:01 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:01 user nova-compute[75292]:       <mac address="fa:16:3e:22:c0:91"/>
Nov 14 14:34:01 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:01 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:01 user nova-compute[75292]:       <target dev="tapcc05278a-0f"/>
Nov 14 14:34:01 user nova-compute[75292]:     </interface>
Nov 14 14:34:01 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:34:01 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/console.log" append="off"/>
Nov 14 14:34:01 user nova-compute[75292]:     </serial>
Nov 14 14:34:01 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:34:01 user nova-compute[75292]:     <video>
Nov 14 14:34:01 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:01 user nova-compute[75292]:     </video>
Nov 14 14:34:01 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:34:01 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:34:01 user nova-compute[75292]:     </rng>
Nov 14 14:34:01 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:34:01 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:34:01 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:34:01 user nova-compute[75292]:     </memballoon>
Nov 14 14:34:01 user nova-compute[75292]:   </devices>
Nov 14 14:34:01 user nova-compute[75292]: </domain>
Nov 14 14:34:01 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1580665728',display_name='tempest-VolumesActionsTest-instance-1580665728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1580665728',id=9,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae397a90f122425485c3b2dd48c4a83b',ramdisk_id='',reservation_id='r-0l67g1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-52200633',owner_user_name='tempest-VolumesActionsTest-52200633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:54Z,user_data=None,user_id='6631dc16c35e4f2b990ee0c9447eaea6',uuid=77551ead-0c38-454e-b6a6-aee54129ae69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Converting VIF {"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG os_vif [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a1f9b2f-b098-54e0-b461-467ed4e9a181', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.policy [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb6f3499107a45788834ea9fc745fe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818b2e390bd14d64ae31a85c51408aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc05278a-0f, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc05278a-0f, col_values=(('qos', UUID('7e2c8f5d-1809-4a9a-bba4-c0d50a953a01')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc05278a-0f, col_values=(('external_ids', {'iface-id': 'cc05278a-0ff3-4def-b0d8-70fb7aa7890d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:c0:91', 'vm-uuid': '77551ead-0c38-454e-b6a6-aee54129ae69'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: INFO os_vif [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f')
Nov 14 14:34:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.243s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] No VIF found with MAC fa:16:3e:22:c0:91, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.253s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk 1073741824" returned: 0 in 0.060s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.224s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Cannot resize image /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Ensure instance console log exists: /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Successfully created port: 3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Updated VIF entry in instance network info cache for port cc05278a-0ff3-4def-b0d8-70fb7aa7890d. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Updating instance_info_cache with network_info: [{"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-498d283b-1843-4c59-abf9-73cea0c3ab7d req-be787093-f837-45e1-8f1c-c1f46fe8aac5 service nova] Releasing lock "refresh_cache-77551ead-0c38-454e-b6a6-aee54129ae69" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Successfully updated port: 3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquired lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-changed-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Refreshing instance network info cache due to event network-changed-3f4bea9a-41aa-42a2-b1ab-a71852e3e972. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] Acquiring lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-bd2b639d-8cce-4b8c-99a4-a5cda9007438 req-5ef16b6c-6c9d-4ca9-96ef-64fefc41698c service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bd2b639d-8cce-4b8c-99a4-a5cda9007438 req-5ef16b6c-6c9d-4ca9-96ef-64fefc41698c service nova] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bd2b639d-8cce-4b8c-99a4-a5cda9007438 req-5ef16b6c-6c9d-4ca9-96ef-64fefc41698c service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bd2b639d-8cce-4b8c-99a4-a5cda9007438 req-5ef16b6c-6c9d-4ca9-96ef-64fefc41698c service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-bd2b639d-8cce-4b8c-99a4-a5cda9007438 req-5ef16b6c-6c9d-4ca9-96ef-64fefc41698c service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] No waiting events found dispatching network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:03 user nova-compute[75292]: WARNING nova.compute.manager [req-bd2b639d-8cce-4b8c-99a4-a5cda9007438 req-5ef16b6c-6c9d-4ca9-96ef-64fefc41698c service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received unexpected event network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d for instance with vm_state building and task_state spawning.
Nov 14 14:34:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updating instance_info_cache with network_info: [{"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Releasing lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Instance network_info: |[{"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] Acquired lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Refreshing network info cache for port 3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Start _get_guest_xml network_info=[{"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:34:04 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:04 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3344827',id=10,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd8CRN0EcdS2nidF9a5wUlDfAvLSnsvCzJjCaMftTwobleIWiLdIbz6yak4Twxv5s02k17eJEQjrppyHkTU5dxZXzqiRnlNAOXAeSez/OsjAoGE6exndbhtL8bzYUcJeA==',key_name='tempest-keypair-1566938889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818b2e390bd14d64ae31a85c51408aca',ramdisk_id='',reservation_id='r-mrne92ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1049711670',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb6f3499107a45788834ea9fc745fe3c',uuid=ca01398a-e681-42df-a1cb-0c89ee029386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Converting VIF {"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lazy-loading 'pci_devices' on Instance uuid ca01398a-e681-42df-a1cb-0c89ee029386 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:34:04 user nova-compute[75292]:   <uuid>ca01398a-e681-42df-a1cb-0c89ee029386</uuid>
Nov 14 14:34:04 user nova-compute[75292]:   <name>instance-0000000a</name>
Nov 14 14:34:04 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:34:04 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:34:04 user nova-compute[75292]:   <metadata>
Nov 14 14:34:04 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:34:04 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:34:04 user nova-compute[75292]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785</nova:name>
Nov 14 14:34:04 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:34:04</nova:creationTime>
Nov 14 14:34:04 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:34:04 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:34:04 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:34:04 user nova-compute[75292]:       <nova:owner>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:user uuid="fb6f3499107a45788834ea9fc745fe3c">tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member</nova:user>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:project uuid="818b2e390bd14d64ae31a85c51408aca">tempest-TestServerVolumeAttachScenarioOldVersion-1049711670</nova:project>
Nov 14 14:34:04 user nova-compute[75292]:       </nova:owner>
Nov 14 14:34:04 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:34:04 user nova-compute[75292]:       <nova:ports>
Nov 14 14:34:04 user nova-compute[75292]:         <nova:port uuid="3f4bea9a-41aa-42a2-b1ab-a71852e3e972">
Nov 14 14:34:04 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 14:34:04 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:04 user nova-compute[75292]:       </nova:ports>
Nov 14 14:34:04 user nova-compute[75292]:     </nova:instance>
Nov 14 14:34:04 user nova-compute[75292]:   </metadata>
Nov 14 14:34:04 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:34:04 user nova-compute[75292]:     <system>
Nov 14 14:34:04 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:34:04 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:34:04 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:34:04 user nova-compute[75292]:       <entry name="serial">ca01398a-e681-42df-a1cb-0c89ee029386</entry>
Nov 14 14:34:04 user nova-compute[75292]:       <entry name="uuid">ca01398a-e681-42df-a1cb-0c89ee029386</entry>
Nov 14 14:34:04 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:34:04 user nova-compute[75292]:     </system>
Nov 14 14:34:04 user nova-compute[75292]:   </sysinfo>
Nov 14 14:34:04 user nova-compute[75292]:   <os>
Nov 14 14:34:04 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:34:04 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:34:04 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:34:04 user nova-compute[75292]:   </os>
Nov 14 14:34:04 user nova-compute[75292]:   <features>
Nov 14 14:34:04 user nova-compute[75292]:     <acpi/>
Nov 14 14:34:04 user nova-compute[75292]:     <apic/>
Nov 14 14:34:04 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:34:04 user nova-compute[75292]:   </features>
Nov 14 14:34:04 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:34:04 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:34:04 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:34:04 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:34:04 user nova-compute[75292]:   </clock>
Nov 14 14:34:04 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:34:04 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:34:04 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:34:04 user nova-compute[75292]:   </cpu>
Nov 14 14:34:04 user nova-compute[75292]:   <devices>
Nov 14 14:34:04 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:34:04 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:34:04 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk"/>
Nov 14 14:34:04 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:34:04 user nova-compute[75292]:     </disk>
Nov 14 14:34:04 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:04 user nova-compute[75292]:       <mac address="fa:16:3e:25:73:52"/>
Nov 14 14:34:04 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:04 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:04 user nova-compute[75292]:       <target dev="tap3f4bea9a-41"/>
Nov 14 14:34:04 user nova-compute[75292]:     </interface>
Nov 14 14:34:04 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:34:04 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/console.log" append="off"/>
Nov 14 14:34:04 user nova-compute[75292]:     </serial>
Nov 14 14:34:04 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:34:04 user nova-compute[75292]:     <video>
Nov 14 14:34:04 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:04 user nova-compute[75292]:     </video>
Nov 14 14:34:04 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:34:04 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:34:04 user nova-compute[75292]:     </rng>
Nov 14 14:34:04 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:34:04 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:34:04 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:34:04 user nova-compute[75292]:     </memballoon>
Nov 14 14:34:04 user nova-compute[75292]:   </devices>
Nov 14 14:34:04 user nova-compute[75292]: </domain>
Nov 14 14:34:04 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3344827',id=10,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd8CRN0EcdS2nidF9a5wUlDfAvLSnsvCzJjCaMftTwobleIWiLdIbz6yak4Twxv5s02k17eJEQjrppyHkTU5dxZXzqiRnlNAOXAeSez/OsjAoGE6exndbhtL8bzYUcJeA==',key_name='tempest-keypair-1566938889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='818b2e390bd14d64ae31a85c51408aca',ramdisk_id='',reservation_id='r-mrne92ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1049711670',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb6f3499107a45788834ea9fc745fe3c',uuid=ca01398a-e681-42df-a1cb-0c89ee029386,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Converting VIF {"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG os_vif [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e7a9fb4-f394-5236-a149-b94381fc7188', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f4bea9a-41, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f4bea9a-41, col_values=(('qos', UUID('7f369f38-6529-4f15-bd0e-dccb32f52d49')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f4bea9a-41, col_values=(('external_ids', {'iface-id': '3f4bea9a-41aa-42a2-b1ab-a71852e3e972', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:73:52', 'vm-uuid': 'ca01398a-e681-42df-a1cb-0c89ee029386'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: INFO os_vif [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41')
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] No VIF found with MAC fa:16:3e:25:73:52, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:34:05 user nova-compute[75292]: INFO nova.compute.claims [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Claim successful on node user
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:34:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Instance spawned successfully.
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updated VIF entry in instance network info cache for port 3f4bea9a-41aa-42a2-b1ab-a71852e3e972. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updating instance_info_cache with network_info: [{"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-baea0da8-08e9-4c9d-9d74-918fb87760f7 req-ead66c8c-f010-4cf0-9cde-ee4935c29e13 service nova] Releasing lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:05 user nova-compute[75292]: INFO nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Took 12.48 seconds to spawn the instance on the hypervisor.
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-66d08295-ab8f-4aa1-9dce-6ead618646b2 req-a94616c0-5631-4765-acc2-48cf936977b8 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66d08295-ab8f-4aa1-9dce-6ead618646b2 req-a94616c0-5631-4765-acc2-48cf936977b8 service nova] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66d08295-ab8f-4aa1-9dce-6ead618646b2 req-a94616c0-5631-4765-acc2-48cf936977b8 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66d08295-ab8f-4aa1-9dce-6ead618646b2 req-a94616c0-5631-4765-acc2-48cf936977b8 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-66d08295-ab8f-4aa1-9dce-6ead618646b2 req-a94616c0-5631-4765-acc2-48cf936977b8 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] No waiting events found dispatching network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:05 user nova-compute[75292]: WARNING nova.compute.manager [req-66d08295-ab8f-4aa1-9dce-6ead618646b2 req-a94616c0-5631-4765-acc2-48cf936977b8 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received unexpected event network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 for instance with vm_state building and task_state spawning.
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:34:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Instance spawned successfully.
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-a162e392-3568-467a-9efb-d619fd1abf09 req-34525a34-a9d2-4ba1-94a2-837499b3ebc9 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a162e392-3568-467a-9efb-d619fd1abf09 req-34525a34-a9d2-4ba1-94a2-837499b3ebc9 service nova] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a162e392-3568-467a-9efb-d619fd1abf09 req-34525a34-a9d2-4ba1-94a2-837499b3ebc9 service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a162e392-3568-467a-9efb-d619fd1abf09 req-34525a34-a9d2-4ba1-94a2-837499b3ebc9 service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-a162e392-3568-467a-9efb-d619fd1abf09 req-34525a34-a9d2-4ba1-94a2-837499b3ebc9 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] No waiting events found dispatching network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:05 user nova-compute[75292]: WARNING nova.compute.manager [req-a162e392-3568-467a-9efb-d619fd1abf09 req-34525a34-a9d2-4ba1-94a2-837499b3ebc9 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received unexpected event network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d for instance with vm_state building and task_state spawning.
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:05 user nova-compute[75292]: INFO nova.compute.manager [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Took 13.75 seconds to build instance.
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9f682f4-1425-4c3c-881d-3b98d4d166f0 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.056s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:06 user nova-compute[75292]: INFO nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Took 12.09 seconds to spawn the instance on the hypervisor.
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:34:06 user nova-compute[75292]: INFO nova.compute.manager [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Took 13.40 seconds to build instance.
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.089s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8c3c74b2-4a97-4fb4-aa97-f5351614cc80 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "77551ead-0c38-454e-b6a6-aee54129ae69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.668s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-7a506aee-3c05-43db-9630-b5dc8df1a076 req-d4970d0b-3e56-4290-b64f-dca457a3476f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a506aee-3c05-43db-9630-b5dc8df1a076 req-d4970d0b-3e56-4290-b64f-dca457a3476f service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a506aee-3c05-43db-9630-b5dc8df1a076 req-d4970d0b-3e56-4290-b64f-dca457a3476f service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a506aee-3c05-43db-9630-b5dc8df1a076 req-d4970d0b-3e56-4290-b64f-dca457a3476f service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-7a506aee-3c05-43db-9630-b5dc8df1a076 req-d4970d0b-3e56-4290-b64f-dca457a3476f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:06 user nova-compute[75292]: WARNING nova.compute.manager [req-7a506aee-3c05-43db-9630-b5dc8df1a076 req-d4970d0b-3e56-4290-b64f-dca457a3476f service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state active and task_state None.
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:34:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:06 user nova-compute[75292]: INFO nova.virt.block_device [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Booting with volume aaa1646a-8a52-4bf2-856a-50822a6f2988 at /dev/vda
Nov 14 14:34:06 user nova-compute[75292]: DEBUG nova.policy [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b6897285dad4ce0a5fa36a4bbe55faf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e71daa8dc5654960a8403aaf6524eb83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG os_brick.utils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:06 user nova-compute[75292]: INFO oslo.privsep.daemon [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpr36nv3a5/privsep.sock']
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:06 user sudo[86342]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpr36nv3a5/privsep.sock
Nov 14 14:34:06 user sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 14:34:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully created port: 5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-043e4b83-5309-4c1e-8895-193eef4da536 req-4c8ff1e8-997b-4255-a7f2-1c871404a5b7 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043e4b83-5309-4c1e-8895-193eef4da536 req-4c8ff1e8-997b-4255-a7f2-1c871404a5b7 service nova] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043e4b83-5309-4c1e-8895-193eef4da536 req-4c8ff1e8-997b-4255-a7f2-1c871404a5b7 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043e4b83-5309-4c1e-8895-193eef4da536 req-4c8ff1e8-997b-4255-a7f2-1c871404a5b7 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-043e4b83-5309-4c1e-8895-193eef4da536 req-4c8ff1e8-997b-4255-a7f2-1c871404a5b7 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] No waiting events found dispatching network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:07 user nova-compute[75292]: WARNING nova.compute.manager [req-043e4b83-5309-4c1e-8895-193eef4da536 req-4c8ff1e8-997b-4255-a7f2-1c871404a5b7 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received unexpected event network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 for instance with vm_state active and task_state None.
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:08 user nova-compute[75292]: WARNING nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state active and task_state None.
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:08 user nova-compute[75292]: WARNING nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state None.
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:08 user nova-compute[75292]: WARNING nova.compute.manager [req-1df0465d-87b0-4912-8231-37b54a9489fa req-8620e46d-dd81-4373-87cd-542df2370198 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state None.
Nov 14 14:34:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:08 user sudo[86342]: pam_unix(sudo:session): session closed for user root
Nov 14 14:34:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully created port: cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:09 user nova-compute[75292]: INFO oslo.privsep.daemon [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Spawned new privsep daemon via rootwrap
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:34:09 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 14:34:09 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 14:34:09 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 14:34:09 user nova-compute[75292]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86373
Nov 14 14:34:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Instance spawned successfully.
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:34:09 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:09 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7509MB free_disk=25.707290649414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eb43df-71b3-4c7d-9af6-55d2780dbb0f]: (2,) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:34:09 user nova-compute[75292]: INFO nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Took 7.78 seconds to spawn the instance on the hypervisor.
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ae5bc-e0a8-4f47-8dad-537ea2bda75b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:09 user nova-compute[75292]: WARNING os_brick.initiator.connectors.nvmeof [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:09 user nova-compute[75292]: INFO nova.compute.manager [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Took 8.67 seconds to build instance.
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f2dce-1207-44ba-9dc1-15b0ecd23ff9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fe7ffa5d-72c5-4b11-8617-ea131d61e4a3 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.790s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17787830-9257-42b4-bfbe-3503737fc071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7baf0530-8fa0-45dc-b343-aee084764967]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 3da9a112-00f0-4ed8-a135-4a35ba0b4233 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ca01398a-e681-42df-a1cb-0c89ee029386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 44726e61-672d-42a1-81ae-489cb41dc49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 092131de-273a-4410-bc2e-84f02a3e081f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 77551ead-0c38-454e-b6a6-aee54129ae69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance d840933b-733f-435d-93cc-d83afd5e2eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:09 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:34:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b47ee-a04a-4f2d-9325-2f1cedca4c44]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG os_brick.utils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== get_connector_properties: return (2755ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating existing volume attachment record: a4e8d873-6c82-455d-9de3-9ef4a49a11dc {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully created port: cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.177s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.746s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:34:10 user nova-compute[75292]: INFO nova.compute.claims [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Claim successful on node user
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully created port: 0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:34:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:34:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.policy [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eaeef475e0554905982ae3762b4e1be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c84debb904cc5b4798f3abc42c05e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully created port: d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "c2c1c552-a700-4429-b258-7d662389822a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:34:11 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Creating image(s)
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "/opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "/opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "/opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:34:11 user nova-compute[75292]: INFO nova.compute.claims [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Claim successful on node user
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.235s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.216s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk 1073741824" returned: 0 in 0.055s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Successfully created port: 6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.271s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:34:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: 5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.918s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port 5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Cannot resize image /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Ensure instance console log exists: /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:34:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:34:12 user nova-compute[75292]: INFO nova.virt.block_device [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Booting with volume 84cb9532-5489-4c53-8aeb-691aa02efbc4 at /dev/vda
Nov 14 14:34:12 user nova-compute[75292]: DEBUG os_brick.utils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[302ae728-f835-43cf-9ff9-6ed8e7f580cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[356396c7-0f5f-4cbc-8a37-366009f413b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1658678f-ee1a-4060-9cad-70d17abc2120]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e09b920-c41d-41e8-8f23-cfbc88cde917]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Successfully updated port: 6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.policy [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adb08a17466e441e9a300c627a840bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b963127017714c239656e80b2af9243f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "refresh_cache-3da9a112-00f0-4ed8-a135-4a35ba0b4233" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquired lock "refresh_cache-3da9a112-00f0-4ed8-a135-4a35ba0b4233" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-changed-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Refreshing instance network info cache due to event network-changed-6fc76e37-cc0f-47f0-846f-287359c36f57. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] Acquiring lock "refresh_cache-3da9a112-00f0-4ed8-a135-4a35ba0b4233" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-719da1bf-0b92-40cb-af6c-4ab1fd872e35 req-8e582434-ffb5-484f-af24-207d0f20a8dd service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:12 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:34:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[803448e7-7062-40da-8477-cd4936a01710]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG os_brick.utils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating existing volume attachment record: 82867b33-c57f-445c-9f47-766d8353810c {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Updating instance_info_cache with network_info: [{"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Releasing lock "refresh_cache-3da9a112-00f0-4ed8-a135-4a35ba0b4233" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Instance network_info: |[{"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] Acquired lock "refresh_cache-3da9a112-00f0-4ed8-a135-4a35ba0b4233" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.neutron [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Refreshing network info cache for port 6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Start _get_guest_xml network_info=[{"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:34:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1031028445',display_name='tempest-VolumesActionsTest-instance-1031028445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1031028445',id=12,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a8c84debb904cc5b4798f3abc42c05e',ramdisk_id='',reservation_id='r-wduim00j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1975132646',owner_user_name='tempest-VolumesActionsTest-1975132646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:11Z,user_data=None,user_id='eaeef475e0554905982ae3762b4e1be6',uuid=3da9a112-00f0-4ed8-a135-4a35ba0b4233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converting VIF {"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lazy-loading 'pci_devices' on Instance uuid 3da9a112-00f0-4ed8-a135-4a35ba0b4233 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:34:13 user nova-compute[75292]:   <uuid>3da9a112-00f0-4ed8-a135-4a35ba0b4233</uuid>
Nov 14 14:34:13 user nova-compute[75292]:   <name>instance-0000000c</name>
Nov 14 14:34:13 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:34:13 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:34:13 user nova-compute[75292]:   <metadata>
Nov 14 14:34:13 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:34:13 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:34:13 user nova-compute[75292]:       <nova:name>tempest-VolumesActionsTest-instance-1031028445</nova:name>
Nov 14 14:34:13 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:34:13</nova:creationTime>
Nov 14 14:34:13 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:34:13 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:34:13 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:34:13 user nova-compute[75292]:       <nova:owner>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:user uuid="eaeef475e0554905982ae3762b4e1be6">tempest-VolumesActionsTest-1975132646-project-member</nova:user>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:project uuid="1a8c84debb904cc5b4798f3abc42c05e">tempest-VolumesActionsTest-1975132646</nova:project>
Nov 14 14:34:13 user nova-compute[75292]:       </nova:owner>
Nov 14 14:34:13 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:34:13 user nova-compute[75292]:       <nova:ports>
Nov 14 14:34:13 user nova-compute[75292]:         <nova:port uuid="6fc76e37-cc0f-47f0-846f-287359c36f57">
Nov 14 14:34:13 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 14:34:13 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:13 user nova-compute[75292]:       </nova:ports>
Nov 14 14:34:13 user nova-compute[75292]:     </nova:instance>
Nov 14 14:34:13 user nova-compute[75292]:   </metadata>
Nov 14 14:34:13 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:34:13 user nova-compute[75292]:     <system>
Nov 14 14:34:13 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:34:13 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:34:13 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:34:13 user nova-compute[75292]:       <entry name="serial">3da9a112-00f0-4ed8-a135-4a35ba0b4233</entry>
Nov 14 14:34:13 user nova-compute[75292]:       <entry name="uuid">3da9a112-00f0-4ed8-a135-4a35ba0b4233</entry>
Nov 14 14:34:13 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:34:13 user nova-compute[75292]:     </system>
Nov 14 14:34:13 user nova-compute[75292]:   </sysinfo>
Nov 14 14:34:13 user nova-compute[75292]:   <os>
Nov 14 14:34:13 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:34:13 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:34:13 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:34:13 user nova-compute[75292]:   </os>
Nov 14 14:34:13 user nova-compute[75292]:   <features>
Nov 14 14:34:13 user nova-compute[75292]:     <acpi/>
Nov 14 14:34:13 user nova-compute[75292]:     <apic/>
Nov 14 14:34:13 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:34:13 user nova-compute[75292]:   </features>
Nov 14 14:34:13 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:34:13 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:34:13 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:34:13 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:34:13 user nova-compute[75292]:   </clock>
Nov 14 14:34:13 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:34:13 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:34:13 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:34:13 user nova-compute[75292]:   </cpu>
Nov 14 14:34:13 user nova-compute[75292]:   <devices>
Nov 14 14:34:13 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:34:13 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:34:13 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk"/>
Nov 14 14:34:13 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:34:13 user nova-compute[75292]:     </disk>
Nov 14 14:34:13 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:13 user nova-compute[75292]:       <mac address="fa:16:3e:96:f2:2e"/>
Nov 14 14:34:13 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:13 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:13 user nova-compute[75292]:       <target dev="tap6fc76e37-cc"/>
Nov 14 14:34:13 user nova-compute[75292]:     </interface>
Nov 14 14:34:13 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:34:13 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/console.log" append="off"/>
Nov 14 14:34:13 user nova-compute[75292]:     </serial>
Nov 14 14:34:13 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:34:13 user nova-compute[75292]:     <video>
Nov 14 14:34:13 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:13 user nova-compute[75292]:     </video>
Nov 14 14:34:13 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:34:13 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:34:13 user nova-compute[75292]:     </rng>
Nov 14 14:34:13 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:34:13 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:34:13 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:34:13 user nova-compute[75292]:     </memballoon>
Nov 14 14:34:13 user nova-compute[75292]:   </devices>
Nov 14 14:34:13 user nova-compute[75292]: </domain>
Nov 14 14:34:13 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1031028445',display_name='tempest-VolumesActionsTest-instance-1031028445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1031028445',id=12,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a8c84debb904cc5b4798f3abc42c05e',ramdisk_id='',reservation_id='r-wduim00j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1975132646',owner_user_name='tempest-VolumesActionsTest-1975132646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:11Z,user_data=None,user_id='eaeef475e0554905982ae3762b4e1be6',uuid=3da9a112-00f0-4ed8-a135-4a35ba0b4233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converting VIF {"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG os_vif [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc1bf0e2-ee0c-5b85-947b-2cce37f06544', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fc76e37-cc, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fc76e37-cc, col_values=(('qos', UUID('38fc611f-d81b-4c45-b03a-65fc5f318145')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fc76e37-cc, col_values=(('external_ids', {'iface-id': '6fc76e37-cc0f-47f0-846f-287359c36f57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f2:2e', 'vm-uuid': '3da9a112-00f0-4ed8-a135-4a35ba0b4233'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:13 user nova-compute[75292]: INFO os_vif [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc')
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully created port: 8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] No VIF found with MAC fa:16:3e:96:f2:2e, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: 6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.neutron [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Updated VIF entry in instance network info cache for port 6fc76e37-cc0f-47f0-846f-287359c36f57. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG nova.network.neutron [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Updating instance_info_cache with network_info: [{"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6291d40a-f5d7-4ed9-b722-bef421d66141 req-9a33491b-4eb4-46fc-81a1-4938468ab41d service nova] Releasing lock "refresh_cache-3da9a112-00f0-4ed8-a135-4a35ba0b4233" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully created port: ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:14 user nova-compute[75292]: WARNING nova.compute.manager [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received unexpected event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with vm_state active and task_state None.
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:14 user nova-compute[75292]: WARNING nova.compute.manager [req-f9e5d914-cee1-4026-8325-c77546c8334f req-e3737fa0-25b2-495e-89de-adb54a593efd service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received unexpected event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with vm_state active and task_state None.
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port 6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:15 user nova-compute[75292]: INFO nova.virt.block_device [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Booting with volume 606c04f8-8a6c-42d8-bb62-bfc7298fe1ea at /dev/vdb
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-459993ac-b0ae-469d-896e-f3ae08bb8cd8 req-cd7ce8a4-16f0-4d7b-b7cb-698910ea3a3b service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[140bff17-2c04-4291-9142-c8bb0489b2eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully created port: 8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb71cc7-bfd4-4da3-90df-8621eef46788]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10d518a-1fe1-4bf8-9494-00a8a6470abc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edbc8c-c27d-4c70-9bfa-9b805eff39cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:16 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b5055-79fc-4b7b-a8bf-c5d30e33e467]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating existing volume attachment record: 30cda381-eeac-4264-a769-f723248f8ad6 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: 0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-cbc05e66-34c2-4cd9-b085-8248d987d5b9. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] No waiting events found dispatching network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:16 user nova-compute[75292]: WARNING nova.compute.manager [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received unexpected event network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 for instance with vm_state building and task_state spawning.
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] No waiting events found dispatching network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:16 user nova-compute[75292]: WARNING nova.compute.manager [req-d8763327-ee62-4d50-b404-ff5ed999e5c9 req-bb7989e6-f020-44f1-aa41-56a8fac69486 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received unexpected event network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 for instance with vm_state building and task_state spawning.
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-cc33ef60-cf8d-4f49-bae3-333d15c4071d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Successfully updated port: d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully created port: 15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-0d226182-76b0-42c1-970f-556bdacc439c. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port 0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd9aadd2-ab3f-4a3d-901c-4c14cd7eb598 req-4f492d63-4f70-4ec8-a8d7-7d6e2390c9d4 service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully created port: 2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:34:17 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Instance spawned successfully.
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:18 user nova-compute[75292]: INFO nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:34:18 user nova-compute[75292]: INFO nova.compute.manager [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Took 8.88 seconds to build instance.
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38b386f8-1eb0-433c-a164-e3f36a578382 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: 8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:18 user nova-compute[75292]: INFO nova.virt.block_device [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Booting with volume 0a2c4473-e6b4-4d46-9e3a-ed5996ce837e at /dev/vdb
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-d584e823-31d5-4103-9d86-2377985e207a. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG os_brick.utils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27e4aaa-7e0b-4107-9528-dc6e24cb3c63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2bfe3b-8abf-493a-8364-3d21a21aae81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4acf9a-0407-49b0-bb54-8ec4af4cbdf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a6f26-019e-417a-99fc-70b1d886eb99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:18 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e8e3e1-f9ae-447b-baec-9712cd77b393]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG os_brick.utils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating existing volume attachment record: 1d26b219-1ce8-436e-858f-cf58d3b4ae1e {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-8fd16284-1189-4ea5-a96f-30b7853b8521. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port 8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7b143188-364f-4c93-825a-ed2621f92788 req-df20efb4-973f-4d69-91fb-7f18b15172ca service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance network_info: |[{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updated VIF entry in instance network info cache for port d584e823-31d5-4103-9d86-2377985e207a. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e492200e-561b-40c5-b529-36a819c4557f req-739c4c2f-f2e3-4a26-88bc-2028366e43dd service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-a51bd563-fde7-4660-aded-2a341093c9c1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: 8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-8caca002-bd65-462d-a092-04e12e9ba1b5. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-c0265d5b-9575-43b8-9364-cbc3bca906e5. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:21 user nova-compute[75292]: INFO nova.virt.block_device [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Booting with volume 2a823006-581f-45c1-86a6-6158ca9ffed4 at /dev/vdc
Nov 14 14:34:21 user nova-compute[75292]: DEBUG os_brick.utils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e755a619-c1cd-463c-a421-235eb41b8f0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac676b7-df44-43a6-a2d9-60b5258b96ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: 15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[65931d78-a33d-4ae7-96b7-d4b0355947f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae46fef-0d03-4272-b650-997d1d2a75a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:22 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a06fcf6-ee8a-4676-8e22-b8eafb097c90]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG os_brick.utils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating existing volume attachment record: 7c883843-d333-49c4-8ec9-41fc8e2a5884 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-ab32bf5e-858b-4989-adbf-1bacc0a61d82. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5f8bea94-73ed-475b-a7c6-ab57569844b4 req-51681888-765e-44b5-a5a8-431526c591e3 service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port 8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b420212e-3cda-4c2a-a3cb-0ddc9e20d5b9 req-939a5cf2-ef0d-4635-864f-2c831a879cb4 service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Successfully updated port: 2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-15fbf7b7-f7a5-4703-9848-648aa5f590d3. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:23 user nova-compute[75292]: INFO nova.virt.block_device [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Booting with volume a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 at /dev/vdc
Nov 14 14:34:24 user nova-compute[75292]: DEBUG os_brick.utils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fe98b7-32ac-4f49-959c-d54be56dabb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3eebbe-fea7-436e-a7a9-d40befd7f003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aab3a8-315d-414b-8bdd-58c63020e345]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf788a29-bc2a-415c-a4e6-2236d2e48b86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:34:24 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:34:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebcb08e-d2d2-4c91-94ba-04848898e5a4]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG os_brick.utils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:24 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating existing volume attachment record: 05464a87-c985-4f8b-8218-c276c743033e {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:34:25 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance network_info: |[{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:34:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:25 user nova-compute[75292]: DEBUG nova.network.neutron [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port 15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updated VIF entry in instance network info cache for port 15fbf7b7-f7a5-4703-9848-648aa5f590d3. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-2d90409f-283d-4e5d-af84-252cb61a50ad. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port 2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updated VIF entry in instance network info cache for port 2d90409f-283d-4e5d-af84-252cb61a50ad. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:34:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c463cc3e-d591-4238-bf8c-5f034bd44813 req-8802904e-4ace-424a-8cf2-00ea4867b68b service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:34:27 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Creating image(s)
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Ensure instance console log exists: /opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Start _get_guest_xml network_info=[{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a4e8d873-6c82-455d-9de3-9ef4a49a11dc', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJfxQzDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6d0c21e-94fd-4a61-8f05-884727be61d2', 'attached_at': '', 'detached_at': '', 'volume_id': 'aaa1646a-8a52-4bf2-856a-50822a6f2988', 'serial': 'aaa1646a-8a52-4bf2-856a-50822a6f2988'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '30cda381-eeac-4264-a769-f723248f8ad6', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZCDLgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6d0c21e-94fd-4a61-8f05-884727be61d2', 'attached_at': '', 'detached_at': '', 'volume_id': '606c04f8-8a6c-42d8-bb62-bfc7298fe1ea', 'serial': '606c04f8-8a6c-42d8-bb62-bfc7298fe1ea'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '7c883843-d333-49c4-8ec9-41fc8e2a5884', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcladKTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b6d0c21e-94fd-4a61-8f05-884727be61d2', 'attached_at': '', 'detached_at': '', 'volume_id': '2a823006-581f-45c1-86a6-6158ca9ffed4', 'serial': '2a823006-581f-45c1-86a6-6158ca9ffed4'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:34:27 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:27 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connector [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Factory for ISCSI on None {{(pid=75292) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJfxQzDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:27 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:27 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:27 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1a782d-f1ea-4bcf-9126-d8fdf891ec94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:34:27 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0608cbe-4b0b-44d1-a052-4cc666f35250]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988] added
Nov 14 14:34:27 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d2fed9-a43e-4e89-a6ba-21c95d29f058]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9a8b5-fc02-44c5-84b7-38b7ca8c7a9f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJfxQzDS {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJfxQzDS" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[45162a19-d1d6-4aaa-8494-2f43ab43a160]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJfxQzDS'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f6983a-66b6-44c3-bb03-0dca14653a30]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44537e9-8d05-4292-8a75-e7e23eb7211e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:34:27 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:34:27 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:27 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 14:34:27 user nova-compute[75292]: 
Nov 14 14:34:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b80d2b9-e548-453d-8cec-bbf26a9136fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260]
Nov 14 14:34:28 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260] successful.
Nov 14 14:34:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.187s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd10465e-b536-4ff2-8d3e-6201a22b79dd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a5048-1749-46aa-8044-ec61c965fa88]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c978713a-cb89-4ac4-9c60-e862e5bf501b]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJfxQzDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:34:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Creating image(s)
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Ensure instance console log exists: /opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Start _get_guest_xml network_info=[{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '82867b33-c57f-445c-9f47-766d8353810c', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCiwclyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2c1c552-a700-4429-b258-7d662389822a', 'attached_at': '', 'detached_at': '', 'volume_id': '84cb9532-5489-4c53-8aeb-691aa02efbc4', 'serial': '84cb9532-5489-4c53-8aeb-691aa02efbc4'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '1d26b219-1ce8-436e-858f-cf58d3b4ae1e', 'boot_index': 1, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXpcLnMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2c1c552-a700-4429-b258-7d662389822a', 'attached_at': '', 'detached_at': '', 'volume_id': '0a2c4473-e6b4-4d46-9e3a-ed5996ce837e', 'serial': '0a2c4473-e6b4-4d46-9e3a-ed5996ce837e'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None}, {'attachment_id': '05464a87-c985-4f8b-8218-c276c743033e', 'boot_index': 2, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJcMHgEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2c1c552-a700-4429-b258-7d662389822a', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54', 'serial': 'a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:34:28 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:28 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:34:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCiwclyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:29 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26339396537383561', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339396537383561', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.042s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:29 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:29 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa5fe4-1c51-4756-8f87-f39281706261]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:34:29 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZCDLgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:29 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eeaf8b-d472-49f0-999d-e24a223ed711]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4] added
Nov 14 14:34:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbd3812-f0ed-46db-ad47-2d874011f805]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e52a4-38aa-49e2-b606-a34de6cadb6b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCiwclyQ {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rCiwclyQ" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a87283-b6be-41fc-8728-afd6f35f370d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rCiwclyQ'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ca0e22-87d8-44f0-9ff5-66536796adf5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccee10dc-8d5d-4ccf-a661-7fb806c451f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[119fdbbc-3de3-4823-8400-0f1dabd0bf16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260]
Nov 14 14:34:29 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260] successful.
Nov 14 14:34:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8dd9e8-c055-4a1f-9c14-dc1c0412692c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[50863be9-b426-4f13-bd71-ff28edb938e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:29 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:29 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6af974-6966-4ca9-8122-1f4e404cd62b]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCiwclyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23965383439316539', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965383439316539', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.270s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:30 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:30 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a6fbda-6cee-482d-92b1-9558d3d78a88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:34:30 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXpcLnMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:30 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a27c8-6db5-414f-99a6-158b202d6b01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea] added
Nov 14 14:34:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef32c5c-296d-4340-b699-2866ac72d4ca]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbdf60c-9eda-4510-957f-565814c255d5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTZCDLgd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTZCDLgd" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f37247-a4bb-4dca-97f7-39ceb7446e76]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTZCDLgd'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34252eb-7f90-4192-b7f6-e913290f935f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7715401-3ff8-4613-abad-3c9be36cc4f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab82f91-27a5-4f08-abc5-647771eee851]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260]
Nov 14 14:34:30 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260] successful.
Nov 14 14:34:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37454e46-cd47-4608-99ef-8acae04765fa]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d813d-9fe8-4c6f-b4ed-a1c254b3709c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:30 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a0753-0147-4169-b01c-45fd3d78775a]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZCDLgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== connect_volume: return (2595ms) {'type': 'block', 'scsi_wwn': '23463356234613437', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463356234613437', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.298s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:31 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:31 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6714a1-2682-499a-9180-8ed664160e1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:34:31 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcladKTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:31 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec8503-6bd1-4e80-a4d1-a3e1ef60d650]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e] added
Nov 14 14:34:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6bcbc-eba0-4d04-9cc2-073eb2b4f813]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1afc45c-9228-40cb-92e2-0847e3dc1dd0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXpcLnMs {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXpcLnMs" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce611153-06ac-450b-831b-6ab46c34f88c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BXpcLnMs'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0088a6ad-967e-4edd-8707-073e6f51ddf0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[96805c4a-f3f2-45f0-bee8-73e25ecb1c25]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9ad70c-d718-4250-a027-474242151806]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260]
Nov 14 14:34:31 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260] successful.
Nov 14 14:34:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[86daffdc-f6e2-4590-8117-19e7e88e87b1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[836f8f7f-7b89-4350-8044-4c873f990959]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:31 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf5200-c46b-411a-be0a-c5341ded3122]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:32 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXpcLnMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== connect_volume: return (2635ms) {'type': 'block', 'scsi_wwn': '26362333365356562', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362333365356562', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:33 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:33 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec2539-fb59-4733-b792-9d752c17f70d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:34:33 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJcMHgEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:34:33 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[188637df-f16c-4259-975d-a8da710547fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4] added
Nov 14 14:34:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c69604-85bc-48ab-87ac-df73ee3e6934]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896e922-dab3-4be1-9871-4ea7ca0d4168]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcladKTR {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcladKTR" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a6397-ca48-4cef-a97c-7fafef490507]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UcladKTR'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc9373-4b9c-48bf-9bda-9efe9f61965c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db50be23-3784-418f-bd0f-a79d17b494fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2e0cc2-a30a-4ba6-a9b0-50f330647eff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260]
Nov 14 14:34:33 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260] successful.
Nov 14 14:34:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[62077faf-4465-4a61-8385-87026c652117]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[032d2a15-8e0a-4c09-840a-bfcd0326fe3d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:33 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:34:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452272b-d4c3-48d5-a093-d21b4a32185b]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcladKTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== connect_volume: return (2635ms) {'type': 'block', 'scsi_wwn': '26638656665313563', 'path': '/dev/sdf'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638656665313563', 'path': '/dev/sdf'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.299s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:34 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d12848-8de3-4e3d-9d8d-7caa7b2fccad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:34:34 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.objects.instance [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lazy-loading 'pci_devices' on Instance uuid b6d0c21e-94fd-4a61-8f05-884727be61d2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd959cfd-9f48-403e-a9c3-2606a344261d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54] added
Nov 14 14:34:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:34:34 user nova-compute[75292]:   <uuid>b6d0c21e-94fd-4a61-8f05-884727be61d2</uuid>
Nov 14 14:34:34 user nova-compute[75292]:   <name>instance-0000000b</name>
Nov 14 14:34:34 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:34:34 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:34:34 user nova-compute[75292]:   <metadata>
Nov 14 14:34:34 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:34:34 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:34:34 user nova-compute[75292]:       <nova:name>tempest-device-tagging-server-244288722</nova:name>
Nov 14 14:34:34 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:34:27</nova:creationTime>
Nov 14 14:34:34 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:34:34 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:34:34 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:34:34 user nova-compute[75292]:       <nova:owner>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:user uuid="3b6897285dad4ce0a5fa36a4bbe55faf">tempest-TaggedBootDevicesTest_v242-412349485-project-member</nova:user>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:project uuid="e71daa8dc5654960a8403aaf6524eb83">tempest-TaggedBootDevicesTest_v242-412349485</nova:project>
Nov 14 14:34:34 user nova-compute[75292]:       </nova:owner>
Nov 14 14:34:34 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:34:34 user nova-compute[75292]:       <nova:ports>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="5987ebf3-7ab4-4bfe-a617-03d5fb4a5473">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="e080b518-6cf3-4608-abf2-8b2c4f5fa7f9">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="cbc05e66-34c2-4cd9-b085-8248d987d5b9">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.218" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="cc33ef60-cf8d-4f49-bae3-333d15c4071d">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.38" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="0d226182-76b0-42c1-970f-556bdacc439c">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:         <nova:port uuid="d584e823-31d5-4103-9d86-2377985e207a">
Nov 14 14:34:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 14:34:34 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:34 user nova-compute[75292]:       </nova:ports>
Nov 14 14:34:34 user nova-compute[75292]:     </nova:instance>
Nov 14 14:34:34 user nova-compute[75292]:   </metadata>
Nov 14 14:34:34 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:34:34 user nova-compute[75292]:     <system>
Nov 14 14:34:34 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:34:34 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:34:34 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:34:34 user nova-compute[75292]:       <entry name="serial">b6d0c21e-94fd-4a61-8f05-884727be61d2</entry>
Nov 14 14:34:34 user nova-compute[75292]:       <entry name="uuid">b6d0c21e-94fd-4a61-8f05-884727be61d2</entry>
Nov 14 14:34:34 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:34:34 user nova-compute[75292]:     </system>
Nov 14 14:34:34 user nova-compute[75292]:   </sysinfo>
Nov 14 14:34:34 user nova-compute[75292]:   <os>
Nov 14 14:34:34 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:34:34 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:34:34 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:34:34 user nova-compute[75292]:   </os>
Nov 14 14:34:34 user nova-compute[75292]:   <features>
Nov 14 14:34:34 user nova-compute[75292]:     <acpi/>
Nov 14 14:34:34 user nova-compute[75292]:     <apic/>
Nov 14 14:34:34 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:34:34 user nova-compute[75292]:   </features>
Nov 14 14:34:34 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:34:34 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:34:34 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:34:34 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:34:34 user nova-compute[75292]:   </clock>
Nov 14 14:34:34 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:34:34 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:34:34 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:34:34 user nova-compute[75292]:   </cpu>
Nov 14 14:34:34 user nova-compute[75292]:   <devices>
Nov 14 14:34:34 user nova-compute[75292]:     <disk type="file" device="cdrom">
Nov 14 14:34:34 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 14:34:34 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2/disk.config"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="hda" bus="ide"/>
Nov 14 14:34:34 user nova-compute[75292]:     </disk>
Nov 14 14:34:34 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:34:34 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:34:34 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <serial>aaa1646a-8a52-4bf2-856a-50822a6f2988</serial>
Nov 14 14:34:34 user nova-compute[75292]:     </disk>
Nov 14 14:34:34 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:34:34 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:34:34 user nova-compute[75292]:       <source dev="/dev/sdd"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <serial>606c04f8-8a6c-42d8-bb62-bfc7298fe1ea</serial>
Nov 14 14:34:34 user nova-compute[75292]:     </disk>
Nov 14 14:34:34 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:34:34 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:34:34 user nova-compute[75292]:       <source dev="/dev/sdf"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="vdc" bus="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <serial>2a823006-581f-45c1-86a6-6158ca9ffed4</serial>
Nov 14 14:34:34 user nova-compute[75292]:     </disk>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:06:4d:23"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tap5987ebf3-7a"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:34:b9:ba"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tape080b518-6c"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:b1:d0:bf"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tap6e4b185b-6e"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:1f:40:cf"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tapcbc05e66-34"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:6b:80:8a"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tapcc33ef60-cf"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:12:be:97"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tap0d226182-76"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:34 user nova-compute[75292]:       <mac address="fa:16:3e:bf:a8:91"/>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:34 user nova-compute[75292]:       <target dev="tapd584e823-31"/>
Nov 14 14:34:34 user nova-compute[75292]:     </interface>
Nov 14 14:34:34 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:34:34 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2/console.log" append="off"/>
Nov 14 14:34:34 user nova-compute[75292]:     </serial>
Nov 14 14:34:34 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:34:34 user nova-compute[75292]:     <video>
Nov 14 14:34:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:34 user nova-compute[75292]:     </video>
Nov 14 14:34:34 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:34:34 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:34:34 user nova-compute[75292]:     </rng>
Nov 14 14:34:34 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:34:34 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:34:34 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:34:34 user nova-compute[75292]:     </memballoon>
Nov 14 14:34:34 user nova-compute[75292]:   </devices>
Nov 14 14:34:34 user nova-compute[75292]: </domain>
Nov 14 14:34:34 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '519aba4c-f83c-5589-9074-e1352f3d3aaa', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7add7de-6611-4b05-a76b-d5cca36d9300]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5987ebf3-7a, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5987ebf3-7a, col_values=(('qos', UUID('7f26cca1-4ffa-4afb-9125-a5c37d817321')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5987ebf3-7a, col_values=(('external_ids', {'iface-id': '5987ebf3-7ab4-4bfe-a617-03d5fb4a5473', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:4d:23', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07a989d-7fa7-4030-8eb5-7f82224bb400]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJcMHgEX {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a')
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '741f5db0-5c0e-51ac-993a-9c6c148d6f82', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJcMHgEX" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c778bab8-25a0-47af-8afc-aadb6b4a06a6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJcMHgEX'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape080b518-6c, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape080b518-6c, col_values=(('qos', UUID('80dab7e1-f14a-49cb-85f9-359bbe942100')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape080b518-6c, col_values=(('external_ids', {'iface-id': 'e080b518-6cf3-4608-abf2-8b2c4f5fa7f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:b9:ba', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17624919-88d9-42a1-910f-41635d768e43]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c')
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76cce233-6217-527f-b9c2-f59e259413d3', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[debd01c4-21f4-4b83-b34f-f6f7ae101025]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e4b185b-6e, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e4b185b-6e, col_values=(('qos', UUID('5e923172-91d1-4e69-b0dc-c55d95095d7c')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e4b185b-6e, col_values=(('external_ids', {'iface-id': '6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:d0:bf', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e')
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ad5f7d71-85f3-5f72-b3e1-ad2845a5daf4', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbcd932-2ee0-45e9-831f-ce47e87296e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260]
Nov 14 14:34:34 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260] successful.
Nov 14 14:34:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbc05e66-34, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbc05e66-34, col_values=(('qos', UUID('72a29837-42cc-4b3c-b577-ace316012b35')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbc05e66-34, col_values=(('external_ids', {'iface-id': 'cbc05e66-34c2-4cd9-b085-8248d987d5b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:40:cf', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83939b0-263a-46fb-8095-48c6960ec5a1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34')
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[50421bc7-7491-420c-81e7-a2bbb68c1c01]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:34:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d755386-d3c0-5e7b-bde0-79c2c2302951', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0509b-fbac-4f01-a4ca-98782ffba80c]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJcMHgEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc33ef60-cf, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc33ef60-cf, col_values=(('qos', UUID('77bd9359-ea69-4bb4-bdbb-c255d8949d08')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc33ef60-cf, col_values=(('external_ids', {'iface-id': 'cc33ef60-cf8d-4f49-bae3-333d15c4071d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:80:8a', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf')
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e19f7dbe-1d1d-58e5-8e2c-9ec8cebf93c2', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d226182-76, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d226182-76, col_values=(('qos', UUID('5cd2d44e-5865-4363-9dcf-c486a28c31c4')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d226182-76, col_values=(('external_ids', {'iface-id': '0d226182-76b0-42c1-970f-556bdacc439c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:be:97', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76')
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0678f863-678a-51a0-838a-6f473ef28121', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd584e823-31, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd584e823-31, col_values=(('qos', UUID('70e4a3a7-07ee-4856-823c-9f553aa87110')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd584e823-31, col_values=(('external_ids', {'iface-id': 'd584e823-31d5-4103-9d86-2377985e207a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:a8:91', 'vm-uuid': 'b6d0c21e-94fd-4a61-8f05-884727be61d2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: INFO os_vif [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31')
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] No BDM found with device name hda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] No VIF found with MAC fa:16:3e:06:4d:23, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] No VIF found with MAC fa:16:3e:6b:80:8a, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Using config drive
Nov 14 14:34:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Creating config drive at /opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2/disk.config
Nov 14 14:34:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph3nbrtng {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph3nbrtng" returned: 0 in 0.070s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== connect_volume: return (2648ms) {'type': 'block', 'scsi_wwn': '23838346230353833', 'path': '/dev/sdg'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838346230353833', 'path': '/dev/sdg'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.objects.instance [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lazy-loading 'pci_devices' on Instance uuid c2c1c552-a700-4429-b258-7d662389822a {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:34:35 user nova-compute[75292]:   <uuid>c2c1c552-a700-4429-b258-7d662389822a</uuid>
Nov 14 14:34:35 user nova-compute[75292]:   <name>instance-0000000d</name>
Nov 14 14:34:35 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:34:35 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:34:35 user nova-compute[75292]:   <metadata>
Nov 14 14:34:35 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:34:35 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:34:35 user nova-compute[75292]:       <nova:name>tempest-device-tagging-server-668574330</nova:name>
Nov 14 14:34:35 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:34:28</nova:creationTime>
Nov 14 14:34:35 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:34:35 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:34:35 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:34:35 user nova-compute[75292]:       <nova:owner>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:user uuid="adb08a17466e441e9a300c627a840bf9">tempest-TaggedBootDevicesTest-479327237-project-member</nova:user>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:project uuid="b963127017714c239656e80b2af9243f">tempest-TaggedBootDevicesTest-479327237</nova:project>
Nov 14 14:34:35 user nova-compute[75292]:       </nova:owner>
Nov 14 14:34:35 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:34:35 user nova-compute[75292]:       <nova:ports>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="8fd16284-1189-4ea5-a96f-30b7853b8521">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="a51bd563-fde7-4660-aded-2a341093c9c1">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.254" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="c0265d5b-9575-43b8-9364-cbc3bca906e5">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="ab32bf5e-858b-4989-adbf-1bacc0a61d82">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="8caca002-bd65-462d-a092-04e12e9ba1b5">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.1.1.43" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="15fbf7b7-f7a5-4703-9848-648aa5f590d3">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:         <nova:port uuid="2d90409f-283d-4e5d-af84-252cb61a50ad">
Nov 14 14:34:35 user nova-compute[75292]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 14:34:35 user nova-compute[75292]:         </nova:port>
Nov 14 14:34:35 user nova-compute[75292]:       </nova:ports>
Nov 14 14:34:35 user nova-compute[75292]:     </nova:instance>
Nov 14 14:34:35 user nova-compute[75292]:   </metadata>
Nov 14 14:34:35 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:34:35 user nova-compute[75292]:     <system>
Nov 14 14:34:35 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:34:35 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:34:35 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:34:35 user nova-compute[75292]:       <entry name="serial">c2c1c552-a700-4429-b258-7d662389822a</entry>
Nov 14 14:34:35 user nova-compute[75292]:       <entry name="uuid">c2c1c552-a700-4429-b258-7d662389822a</entry>
Nov 14 14:34:35 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:34:35 user nova-compute[75292]:     </system>
Nov 14 14:34:35 user nova-compute[75292]:   </sysinfo>
Nov 14 14:34:35 user nova-compute[75292]:   <os>
Nov 14 14:34:35 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:34:35 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:34:35 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:34:35 user nova-compute[75292]:   </os>
Nov 14 14:34:35 user nova-compute[75292]:   <features>
Nov 14 14:34:35 user nova-compute[75292]:     <acpi/>
Nov 14 14:34:35 user nova-compute[75292]:     <apic/>
Nov 14 14:34:35 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:34:35 user nova-compute[75292]:   </features>
Nov 14 14:34:35 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:34:35 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:34:35 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:34:35 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:34:35 user nova-compute[75292]:   </clock>
Nov 14 14:34:35 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:34:35 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:34:35 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:34:35 user nova-compute[75292]:   </cpu>
Nov 14 14:34:35 user nova-compute[75292]:   <devices>
Nov 14 14:34:35 user nova-compute[75292]:     <disk type="file" device="cdrom">
Nov 14 14:34:35 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 14:34:35 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a/disk.config"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="hda" bus="ide"/>
Nov 14 14:34:35 user nova-compute[75292]:     </disk>
Nov 14 14:34:35 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:34:35 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:34:35 user nova-compute[75292]:       <source dev="/dev/sdc"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <serial>84cb9532-5489-4c53-8aeb-691aa02efbc4</serial>
Nov 14 14:34:35 user nova-compute[75292]:     </disk>
Nov 14 14:34:35 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:34:35 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:34:35 user nova-compute[75292]:       <source dev="/dev/sde"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <serial>0a2c4473-e6b4-4d46-9e3a-ed5996ce837e</serial>
Nov 14 14:34:35 user nova-compute[75292]:     </disk>
Nov 14 14:34:35 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:34:35 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:34:35 user nova-compute[75292]:       <source dev="/dev/sdg"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="vdc" bus="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <serial>a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54</serial>
Nov 14 14:34:35 user nova-compute[75292]:     </disk>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:23:e2:dd"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tap8fd16284-11"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:a6:bd:0b"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tapa51bd563-fd"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:c7:27:b2"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tapc0265d5b-95"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:a6:f5:ac"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tapab32bf5e-85"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:38:88:f6"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tap8caca002-bd"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:da:a2:59"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tap15fbf7b7-f7"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:34:35 user nova-compute[75292]:       <mac address="fa:16:3e:73:ef:b4"/>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:34:35 user nova-compute[75292]:       <target dev="tap2d90409f-28"/>
Nov 14 14:34:35 user nova-compute[75292]:     </interface>
Nov 14 14:34:35 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:34:35 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a/console.log" append="off"/>
Nov 14 14:34:35 user nova-compute[75292]:     </serial>
Nov 14 14:34:35 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:34:35 user nova-compute[75292]:     <video>
Nov 14 14:34:35 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:34:35 user nova-compute[75292]:     </video>
Nov 14 14:34:35 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:34:35 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:34:35 user nova-compute[75292]:     </rng>
Nov 14 14:34:35 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:34:35 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:34:35 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:34:35 user nova-compute[75292]:     </memballoon>
Nov 14 14:34:35 user nova-compute[75292]:   </devices>
Nov 14 14:34:35 user nova-compute[75292]: </domain>
Nov 14 14:34:35 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '670f13c1-521b-5061-aef3-ecd4d1fba5f7', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fd16284-11, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fd16284-11, col_values=(('qos', UUID('90388932-cbca-428a-ba16-f4c3b85a381d')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fd16284-11, col_values=(('external_ids', {'iface-id': '8fd16284-1189-4ea5-a96f-30b7853b8521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:e2:dd', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11')
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6c67159-2070-558a-b12a-ce0722cce993', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa51bd563-fd, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa51bd563-fd, col_values=(('qos', UUID('87684479-4d1e-4e24-8526-d82fe09ef302')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa51bd563-fd, col_values=(('external_ids', {'iface-id': 'a51bd563-fde7-4660-aded-2a341093c9c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:bd:0b', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd')
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a6b7bcb-0bbc-5e7d-bd9a-887081d999d4', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0265d5b-95, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0265d5b-95, col_values=(('qos', UUID('89634e2b-24b1-48d0-b662-f369a7abaa76')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0265d5b-95, col_values=(('external_ids', {'iface-id': 'c0265d5b-9575-43b8-9364-cbc3bca906e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:27:b2', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95')
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0223dc72-0ced-5525-a1e2-3e3752e7497c', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab32bf5e-85, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab32bf5e-85, col_values=(('qos', UUID('09ef1ba2-e75a-4e25-b9a4-35fd5f431416')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab32bf5e-85, col_values=(('external_ids', {'iface-id': 'ab32bf5e-858b-4989-adbf-1bacc0a61d82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:f5:ac', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85')
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa38d7c2-1310-5dc6-8869-e82650932a39', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8caca002-bd, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8caca002-bd, col_values=(('qos', UUID('6bb5b64b-5368-4d96-bf42-358bbaefe4f1')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8caca002-bd, col_values=(('external_ids', {'iface-id': '8caca002-bd65-462d-a092-04e12e9ba1b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:88:f6', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd')
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1541a3dc-e246-5125-80f1-10642e912577', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15fbf7b7-f7, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15fbf7b7-f7, col_values=(('qos', UUID('2997abc0-2241-4eb8-aa58-f4c6ac498c07')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15fbf7b7-f7, col_values=(('external_ids', {'iface-id': '15fbf7b7-f7a5-4703-9848-648aa5f590d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:a2:59', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7')
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6417445-f2d4-5aa1-bc74-0156a094d6b2', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d90409f-28, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d90409f-28, col_values=(('qos', UUID('30d182ec-4374-4f49-a407-0b21a03ade78')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d90409f-28, col_values=(('external_ids', {'iface-id': '2d90409f-283d-4e5d-af84-252cb61a50ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:ef:b4', 'vm-uuid': 'c2c1c552-a700-4429-b258-7d662389822a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: INFO os_vif [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28')
Nov 14 14:34:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] No BDM found with device name hda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] No VIF found with MAC fa:16:3e:23:e2:dd, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] No VIF found with MAC fa:16:3e:38:88:f6, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:34:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Using config drive
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-a6f21a3c-58ca-4282-8e35-662e816f6ef2 req-e44c3d96-d783-466a-a3e9-d544f0929776 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a6f21a3c-58ca-4282-8e35-662e816f6ef2 req-e44c3d96-d783-466a-a3e9-d544f0929776 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a6f21a3c-58ca-4282-8e35-662e816f6ef2 req-e44c3d96-d783-466a-a3e9-d544f0929776 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a6f21a3c-58ca-4282-8e35-662e816f6ef2 req-e44c3d96-d783-466a-a3e9-d544f0929776 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-a6f21a3c-58ca-4282-8e35-662e816f6ef2 req-e44c3d96-d783-466a-a3e9-d544f0929776 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:37 user nova-compute[75292]: WARNING nova.compute.manager [req-a6f21a3c-58ca-4282-8e35-662e816f6ef2 req-e44c3d96-d783-466a-a3e9-d544f0929776 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 for instance with vm_state building and task_state spawning.
Nov 14 14:34:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Creating config drive at /opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a/disk.config
Nov 14 14:34:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm8kwhvvn {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpm8kwhvvn" returned: 0 in 0.051s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-a030f11f-0c8e-466e-a97a-b09562df8de1 req-5da3d4cb-a4d1-45f6-99c3-9300242b7c3a service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a030f11f-0c8e-466e-a97a-b09562df8de1 req-5da3d4cb-a4d1-45f6-99c3-9300242b7c3a service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a030f11f-0c8e-466e-a97a-b09562df8de1 req-5da3d4cb-a4d1-45f6-99c3-9300242b7c3a service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a030f11f-0c8e-466e-a97a-b09562df8de1 req-5da3d4cb-a4d1-45f6-99c3-9300242b7c3a service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-a030f11f-0c8e-466e-a97a-b09562df8de1 req-5da3d4cb-a4d1-45f6-99c3-9300242b7c3a service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:38 user nova-compute[75292]: WARNING nova.compute.manager [req-a030f11f-0c8e-466e-a97a-b09562df8de1 req-5da3d4cb-a4d1-45f6-99c3-9300242b7c3a service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 for instance with vm_state building and task_state spawning.
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:39 user nova-compute[75292]: WARNING nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 for instance with vm_state building and task_state spawning.
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:39 user nova-compute[75292]: WARNING nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 for instance with vm_state building and task_state spawning.
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:39 user nova-compute[75292]: WARNING nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 for instance with vm_state building and task_state spawning.
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:39 user nova-compute[75292]: WARNING nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 for instance with vm_state building and task_state spawning.
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:39 user nova-compute[75292]: WARNING nova.compute.manager [req-1d92a416-b56a-4d7a-9e82-4810dd73a8a5 req-45cc3471-6f28-4c5d-9190-fd4e1f5aa98e service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 for instance with vm_state building and task_state spawning.
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-8c3b62ff-33b1-4873-97b2-3ed44f8350cc req-fd2a8d47-df7c-440a-96db-8f2ac2894b23 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8c3b62ff-33b1-4873-97b2-3ed44f8350cc req-fd2a8d47-df7c-440a-96db-8f2ac2894b23 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8c3b62ff-33b1-4873-97b2-3ed44f8350cc req-fd2a8d47-df7c-440a-96db-8f2ac2894b23 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8c3b62ff-33b1-4873-97b2-3ed44f8350cc req-fd2a8d47-df7c-440a-96db-8f2ac2894b23 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-8c3b62ff-33b1-4873-97b2-3ed44f8350cc req-fd2a8d47-df7c-440a-96db-8f2ac2894b23 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:40 user nova-compute[75292]: WARNING nova.compute.manager [req-8c3b62ff-33b1-4873-97b2-3ed44f8350cc req-fd2a8d47-df7c-440a-96db-8f2ac2894b23 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a for instance with vm_state building and task_state spawning.
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:40 user nova-compute[75292]: WARNING nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 for instance with vm_state building and task_state spawning.
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:40 user nova-compute[75292]: WARNING nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d for instance with vm_state building and task_state spawning.
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:40 user nova-compute[75292]: WARNING nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d for instance with vm_state building and task_state spawning.
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:40 user nova-compute[75292]: WARNING nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c for instance with vm_state building and task_state spawning.
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:40 user nova-compute[75292]: WARNING nova.compute.manager [req-37d33d4c-ec5c-4855-befb-a2b4fd64394b req-c8b06641-2d69-4e31-8ef2-66c4072bbe75 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c for instance with vm_state building and task_state spawning.
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:41 user nova-compute[75292]: WARNING nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 for instance with vm_state building and task_state spawning.
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:41 user nova-compute[75292]: WARNING nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 for instance with vm_state building and task_state spawning.
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:41 user nova-compute[75292]: WARNING nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 for instance with vm_state building and task_state spawning.
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:41 user nova-compute[75292]: WARNING nova.compute.manager [req-e340107d-ac9e-4cdc-9270-aac96ccce4dd req-347e2459-fecc-4fc9-ac38-42b60a2a4c92 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 for instance with vm_state building and task_state spawning.
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-163ddf58-48f4-4291-bba4-82fc62ddc242 req-318e44b3-5821-4e06-927e-c7a2a56b5fcd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-163ddf58-48f4-4291-bba4-82fc62ddc242 req-318e44b3-5821-4e06-927e-c7a2a56b5fcd service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-163ddf58-48f4-4291-bba4-82fc62ddc242 req-318e44b3-5821-4e06-927e-c7a2a56b5fcd service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-163ddf58-48f4-4291-bba4-82fc62ddc242 req-318e44b3-5821-4e06-927e-c7a2a56b5fcd service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-163ddf58-48f4-4291-bba4-82fc62ddc242 req-318e44b3-5821-4e06-927e-c7a2a56b5fcd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:42 user nova-compute[75292]: WARNING nova.compute.manager [req-163ddf58-48f4-4291-bba4-82fc62ddc242 req-318e44b3-5821-4e06-927e-c7a2a56b5fcd service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a for instance with vm_state building and task_state spawning.
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:42 user nova-compute[75292]: WARNING nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 for instance with vm_state building and task_state spawning.
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:42 user nova-compute[75292]: WARNING nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 for instance with vm_state building and task_state spawning.
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:42 user nova-compute[75292]: WARNING nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 for instance with vm_state building and task_state spawning.
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:42 user nova-compute[75292]: WARNING nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 for instance with vm_state building and task_state spawning.
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:42 user nova-compute[75292]: WARNING nova.compute.manager [req-ea1e7c34-7ffc-401d-ba9c-ada270ff6199 req-eb06545d-e179-4a89-b654-d81320bad75b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 for instance with vm_state building and task_state spawning.
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:43 user nova-compute[75292]: WARNING nova.compute.manager [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 for instance with vm_state building and task_state spawning.
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:43 user nova-compute[75292]: WARNING nova.compute.manager [req-22f4c8ba-24bb-4cbf-b3d0-24e130bf3c17 req-11d86ec0-f1e1-4440-8e27-a92704dd928b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 for instance with vm_state building and task_state spawning.
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:34:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance spawned successfully.
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:43 user nova-compute[75292]: INFO nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Took 16.43 seconds to spawn the instance on the hypervisor.
Nov 14 14:34:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:44 user nova-compute[75292]: INFO nova.compute.manager [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Took 38.99 seconds to build instance.
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-05e3e1dd-9b73-47c0-b693-61839b51ea5f tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.106s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:44 user nova-compute[75292]: WARNING nova.compute.manager [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad for instance with vm_state building and task_state spawning.
Nov 14 14:34:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:44 user nova-compute[75292]: WARNING nova.compute.manager [req-ea18e103-8954-4ce4-b447-654d1dd1a878 req-45d36398-4fe7-45a3-9221-47ea03bb34ee service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad for instance with vm_state building and task_state spawning.
Nov 14 14:34:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-66e55c2f-3413-4598-9b2b-b6e7ea585dd6 req-32ad634d-8526-4947-adda-463bbce2419b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66e55c2f-3413-4598-9b2b-b6e7ea585dd6 req-32ad634d-8526-4947-adda-463bbce2419b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66e55c2f-3413-4598-9b2b-b6e7ea585dd6 req-32ad634d-8526-4947-adda-463bbce2419b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66e55c2f-3413-4598-9b2b-b6e7ea585dd6 req-32ad634d-8526-4947-adda-463bbce2419b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-66e55c2f-3413-4598-9b2b-b6e7ea585dd6 req-32ad634d-8526-4947-adda-463bbce2419b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:34:44 user nova-compute[75292]: WARNING nova.compute.manager [req-66e55c2f-3413-4598-9b2b-b6e7ea585dd6 req-32ad634d-8526-4947-adda-463bbce2419b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 for instance with vm_state building and task_state spawning.
Nov 14 14:34:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:34:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance spawned successfully.
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:34:45 user nova-compute[75292]: INFO nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Took 16.17 seconds to spawn the instance on the hypervisor.
Nov 14 14:34:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:34:45 user nova-compute[75292]: INFO nova.compute.manager [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Took 33.98 seconds to build instance.
Nov 14 14:34:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08c6b670-c982-412e-a459-ea87f37aaa75 tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "c2c1c552-a700-4429-b258-7d662389822a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.119s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:34:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:34:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-changed-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Refreshing instance network info cache due to event network-changed-681ed373-e78f-4440-9658-ae5f20726f63. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Refreshing network info cache for port 681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:01 user nova-compute[75292]: INFO nova.compute.manager [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Rescuing
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updated VIF entry in instance network info cache for port 681ed373-e78f-4440-9658-ae5f20726f63. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0639bba9-32ce-4e34-9104-04fdd363e082 req-00a013e6-508b-4cfe-a489-e20441323a0c service nova] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-063b593d-3135-4850-b098-24f743cfafa8 req-01125951-ebd4-4670-9c1e-b90d8b818905 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-unplugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-063b593d-3135-4850-b098-24f743cfafa8 req-01125951-ebd4-4670-9c1e-b90d8b818905 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-063b593d-3135-4850-b098-24f743cfafa8 req-01125951-ebd4-4670-9c1e-b90d8b818905 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-063b593d-3135-4850-b098-24f743cfafa8 req-01125951-ebd4-4670-9c1e-b90d8b818905 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-063b593d-3135-4850-b098-24f743cfafa8 req-01125951-ebd4-4670-9c1e-b90d8b818905 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-unplugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:02 user nova-compute[75292]: WARNING nova.compute.manager [req-063b593d-3135-4850-b098-24f743cfafa8 req-01125951-ebd4-4670-9c1e-b90d8b818905 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-unplugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state active and task_state rescuing.
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:02 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance destroyed successfully.
Nov 14 14:35:02 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Attempting rescue
Nov 14 14:35:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75292) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:35:02 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Creating image(s)
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue" returned: 0 in 0.048s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'migration_context' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.base [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<fcc51f4f-7b46-4475-9cbf-53421eb0803f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Start _get_guest_xml network_info=[{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:4d:f2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'resources' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.base [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<fcc51f4f-7b46-4475-9cbf-53421eb0803f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'numa_topology' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.base [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<fcc51f4f-7b46-4475-9cbf-53421eb0803f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:35:03 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:35:03 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.base [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<fcc51f4f-7b46-4475-9cbf-53421eb0803f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1530529335',display_name='tempest-ServerRescueNegativeTestJSON-server-1530529335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1530529335',id=3,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-fiv5ql8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:31Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=fcc51f4f-7b46-4475-9cbf-53421eb0803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:4d:f2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:4d:f2:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'pci_devices' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.objects.base [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<fcc51f4f-7b46-4475-9cbf-53421eb0803f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:35:03 user nova-compute[75292]:   <uuid>fcc51f4f-7b46-4475-9cbf-53421eb0803f</uuid>
Nov 14 14:35:03 user nova-compute[75292]:   <name>instance-00000003</name>
Nov 14 14:35:03 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:35:03 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:35:03 user nova-compute[75292]:   <metadata>
Nov 14 14:35:03 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:35:03 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:35:03 user nova-compute[75292]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1530529335</nova:name>
Nov 14 14:35:03 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:35:03</nova:creationTime>
Nov 14 14:35:03 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:35:03 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:35:03 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:35:03 user nova-compute[75292]:       <nova:owner>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:user uuid="9970be0d6d0a4c7193237192da054e8c">tempest-ServerRescueNegativeTestJSON-1737174677-project-member</nova:user>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:project uuid="850c4eb7326f46c59998de50b99686c0">tempest-ServerRescueNegativeTestJSON-1737174677</nova:project>
Nov 14 14:35:03 user nova-compute[75292]:       </nova:owner>
Nov 14 14:35:03 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:35:03 user nova-compute[75292]:       <nova:ports>
Nov 14 14:35:03 user nova-compute[75292]:         <nova:port uuid="f34cfacd-c6a0-40a5-894b-98b4c7c5cf47">
Nov 14 14:35:03 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 14:35:03 user nova-compute[75292]:         </nova:port>
Nov 14 14:35:03 user nova-compute[75292]:       </nova:ports>
Nov 14 14:35:03 user nova-compute[75292]:     </nova:instance>
Nov 14 14:35:03 user nova-compute[75292]:   </metadata>
Nov 14 14:35:03 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:35:03 user nova-compute[75292]:     <system>
Nov 14 14:35:03 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:35:03 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:35:03 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:35:03 user nova-compute[75292]:       <entry name="serial">fcc51f4f-7b46-4475-9cbf-53421eb0803f</entry>
Nov 14 14:35:03 user nova-compute[75292]:       <entry name="uuid">fcc51f4f-7b46-4475-9cbf-53421eb0803f</entry>
Nov 14 14:35:03 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:35:03 user nova-compute[75292]:     </system>
Nov 14 14:35:03 user nova-compute[75292]:   </sysinfo>
Nov 14 14:35:03 user nova-compute[75292]:   <os>
Nov 14 14:35:03 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:35:03 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:35:03 user nova-compute[75292]:   </os>
Nov 14 14:35:03 user nova-compute[75292]:   <features>
Nov 14 14:35:03 user nova-compute[75292]:     <acpi/>
Nov 14 14:35:03 user nova-compute[75292]:     <apic/>
Nov 14 14:35:03 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:35:03 user nova-compute[75292]:   </features>
Nov 14 14:35:03 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:35:03 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:35:03 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:35:03 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:35:03 user nova-compute[75292]:   </clock>
Nov 14 14:35:03 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:35:03 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:35:03 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:35:03 user nova-compute[75292]:   </cpu>
Nov 14 14:35:03 user nova-compute[75292]:   <devices>
Nov 14 14:35:03 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:35:03 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:35:03 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue"/>
Nov 14 14:35:03 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:35:03 user nova-compute[75292]:     </disk>
Nov 14 14:35:03 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:35:03 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:35:03 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk"/>
Nov 14 14:35:03 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:35:03 user nova-compute[75292]:     </disk>
Nov 14 14:35:03 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:35:03 user nova-compute[75292]:       <mac address="fa:16:3e:4d:f2:d8"/>
Nov 14 14:35:03 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:35:03 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:35:03 user nova-compute[75292]:       <target dev="tapf34cfacd-c6"/>
Nov 14 14:35:03 user nova-compute[75292]:     </interface>
Nov 14 14:35:03 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:35:03 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/console.log" append="off"/>
Nov 14 14:35:03 user nova-compute[75292]:     </serial>
Nov 14 14:35:03 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:35:03 user nova-compute[75292]:     <video>
Nov 14 14:35:03 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:35:03 user nova-compute[75292]:     </video>
Nov 14 14:35:03 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:35:03 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:35:03 user nova-compute[75292]:     </rng>
Nov 14 14:35:03 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:35:03 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:35:03 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:35:03 user nova-compute[75292]:     </memballoon>
Nov 14 14:35:03 user nova-compute[75292]:   </devices>
Nov 14 14:35:03 user nova-compute[75292]: </domain>
Nov 14 14:35:03 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance destroyed successfully.
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:4d:f2:d8, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json" returned: 0 in 0.422s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-changed-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Refreshing instance network info cache due to event network-changed-efebda64-96d8-427d-b777-b43803cb2e92. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Refreshing network info cache for port efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-e68546f1-0d86-4615-af3c-467f849a986c req-c89fbed0-eb43-4ca5-a3ee-178ed9e632c4 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e68546f1-0d86-4615-af3c-467f849a986c req-c89fbed0-eb43-4ca5-a3ee-178ed9e632c4 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e68546f1-0d86-4615-af3c-467f849a986c req-c89fbed0-eb43-4ca5-a3ee-178ed9e632c4 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e68546f1-0d86-4615-af3c-467f849a986c req-c89fbed0-eb43-4ca5-a3ee-178ed9e632c4 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-e68546f1-0d86-4615-af3c-467f849a986c req-c89fbed0-eb43-4ca5-a3ee-178ed9e632c4 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:04 user nova-compute[75292]: WARNING nova.compute.manager [req-e68546f1-0d86-4615-af3c-467f849a986c req-c89fbed0-eb43-4ca5-a3ee-178ed9e632c4 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state active and task_state rescuing.
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updated VIF entry in instance network info cache for port efebda64-96d8-427d-b777-b43803cb2e92. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb88b550-0c77-431d-ace1-333b5fbf36b8 req-fd466e62-6f5a-4454-a0a3-65bfc1ebe6c9 service nova] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:35:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:35:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:35:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=6451MB free_disk=25.520641326904297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 44726e61-672d-42a1-81ae-489cb41dc49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 092131de-273a-4410-bc2e-84f02a3e081f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance d840933b-733f-435d-93cc-d83afd5e2eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 77551ead-0c38-454e-b6a6-aee54129ae69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ca01398a-e681-42df-a1cb-0c89ee029386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 3da9a112-00f0-4ed8-a135-4a35ba0b4233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c2c1c552-a700-4429-b258-7d662389822a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:06 user nova-compute[75292]: WARNING nova.compute.manager [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state active and task_state rescuing.
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:06 user nova-compute[75292]: WARNING nova.compute.manager [req-6ad2a600-95bb-4f89-aa05-4843ebd4f4e3 req-2c870edd-61d1-4a42-9e33-47a0aae68090 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state active and task_state rescuing.
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:35:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1f109658-6e00-4b84-b747-ef350ec9ad7d tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:35:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:35:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:35:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-changed-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Refreshing instance network info cache due to event network-changed-0113c6de-745c-4af7-8e3d-43ac3f4cba4e. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] Acquiring lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] Acquired lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Refreshing network info cache for port 0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updated VIF entry in instance network info cache for port 0113c6de-745c-4af7-8e3d-43ac3f4cba4e. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updating instance_info_cache with network_info: [{"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-61714d5b-04a7-407c-bd53-b62e0de4ced4 req-c86bd815-a9fc-4167-90c1-124696cbd10b service nova] Releasing lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'flavor' on Instance uuid 44726e61-672d-42a1-81ae-489cb41dc49e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:18 user nova-compute[75292]: INFO nova.compute.manager [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Attaching volume 03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 to /dev/vdb
Nov 14 14:35:18 user nova-compute[75292]: DEBUG os_brick.utils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[036a1fa5-31c9-4630-ba3f-f9f001b0e40c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4fce70-bac2-4205-81f5-12c9fa7d227c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f202d3d5-b228-4659-a23c-04b02d6fe034]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b8c2d8-3abd-4e28-b554-c766a7eba5da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:18 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af3dbe-fce2-4e0c-9b99-f062a1b2921b]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG os_brick.utils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:18 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updating existing volume attachment record: b65e0449-0263-4967-84e8-972c58f27e24 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:35:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-changed-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Refreshing instance network info cache due to event network-changed-b3808b25-fd92-4056-9613-50163da2a577. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] Acquiring lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] Acquired lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Refreshing network info cache for port b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updated VIF entry in instance network info cache for port b3808b25-fd92-4056-9613-50163da2a577. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updating instance_info_cache with network_info: [{"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33f8b7c0-5357-449f-b0c8-f0b4902a8751 req-dc84d2f0-141e-4ecd-abaa-630f3d79146a service nova] Releasing lock "refresh_cache-2f019191-1147-4e62-8680-3a6cd7fcfe78" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:21 user nova-compute[75292]: DEBUG nova.objects.instance [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lazy-loading 'flavor' on Instance uuid 2f019191-1147-4e62-8680-3a6cd7fcfe78 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:22 user nova-compute[75292]: INFO nova.compute.manager [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Attaching volume 00906fbb-144c-4f2f-809f-e635e15c7935 to /dev/sdc
Nov 14 14:35:22 user nova-compute[75292]: DEBUG os_brick.utils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e0d8f-9ea7-4ce4-a65e-48c75d3fae65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f50d6-076f-4a7e-8087-ccac5b19b2d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[450eebc3-41d6-4e86-a507-0f650340057a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c74881e-7ad6-4bd9-b9fb-e9bba5125b46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:22 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:22 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfe47a8-e57b-4534-b42b-b24ebe17f8f4]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG os_brick.utils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:22 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updating existing volume attachment record: 0e3f1f4b-5f0a-47e4-a308-f14ccb6781ca {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqdFvWwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:23 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fca37f-919c-4178-9fa5-48dc87fd1b40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:23 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5658b4b2-2848-4d4b-a30e-fe7307d8da27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710] added
Nov 14 14:35:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[00097d65-e817-45e5-be70-5f1f6c9988c3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08fb00e-4a11-4473-924c-2370fa1942e9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqdFvWwX {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqdFvWwX" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7223b975-fc1e-4c7f-ab7e-5fba8a4a7f9a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QqdFvWwX'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e439af3-3ba1-4d2b-8676-6e3553993542]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149ffed-6aef-4e1b-aaf2-c5de78c444df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --login" returned: 0 in 0.259s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41168585-5cb6-4b6f-9eda-1cef84759278]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260]
Nov 14 14:35:23 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd9a116-f5c6-4155-8492-743f69814353]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd4c861-5b13-4cfe-9ae8-65f85e9e5269]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.529s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.034s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c969b5ac-630e-4ffe-9c91-7134cc6c09a7]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqdFvWwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:35:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.594s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] <== connect_volume: return (1596ms) {'type': 'block', 'scsi_wwn': '26366333361316536', 'path': '/dev/sdh'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366333361316536', 'path': '/dev/sdh'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'flavor' on Instance uuid 44726e61-672d-42a1-81ae-489cb41dc49e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:35:25 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:25 user nova-compute[75292]:   <source dev="/dev/sdh"/>
Nov 14 14:35:25 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:25 user nova-compute[75292]:   <serial>03f835e2-1b3d-4df8-9cb6-2d2df2b8b710</serial>
Nov 14 14:35:25 user nova-compute[75292]: </disk>
Nov 14 14:35:25 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No VIF found with MAC fa:16:3e:6f:07:d2, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:35:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b79c0c6c-e11b-4f52-a7e1-a066878a5a36 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.913s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-changed-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Refreshing instance network info cache due to event network-changed-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] Acquiring lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] Acquired lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Refreshing network info cache for port cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.objects.instance [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lazy-loading 'flavor' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiQkvLNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:26 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:26 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:26 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:26 user nova-compute[75292]: INFO nova.compute.manager [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Attaching volume f34b87ca-9ab8-4354-abe2-d115d9d5668a to /dev/vdb
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updated VIF entry in instance network info cache for port cbb45e39-31ab-4b6d-a3d8-2fd7337c6099. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG nova.network.neutron [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updating instance_info_cache with network_info: [{"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[454b66ea-22fe-46cd-bb60-2f0e8d839e89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:26 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8e692c28-b7ef-4d2c-8211-50e52e5bc4aa req-d75dbe0e-14a8-41f8-807b-daef3f94b524 service nova] Releasing lock "refresh_cache-092131de-273a-4410-bc2e-84f02a3e081f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb52da0e-a9be-4c6a-9620-5eafb22df3b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935] added
Nov 14 14:35:26 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.utils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7702e4-a408-4b67-80ec-64cbfb964b15]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db66b65-8bbb-4bba-a880-e815a721b18c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[70718b26-99ee-4455-8165-4801f47ada21]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d85754b-65c7-4bf2-b821-0dd6641fc1a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiQkvLNe {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[57083348-c5c6-4d60-99cf-8930ab4d5312]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CiQkvLNe" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d75e64-dc23-455e-a066-e23d720403bc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CiQkvLNe'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4672e064-61bb-4c60-ae34-fb7659e034f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785a520-7635-4c48-aeb2-71bc513212a9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:27 user nova-compute[75292]: INFO nova.compute.manager [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Detaching volume 03f835e2-1b3d-4df8-9cb6-2d2df2b8b710
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:27 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd2f7fc-bb56-48e9-9ba3-c1deb8fa5874]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.utils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updating existing volume attachment record: 79691d2c-54bf-401e-ade8-81d53e3e031d {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d0684-a8b4-4a04-9b42-b48f6f471288]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:27 user nova-compute[75292]: INFO nova.virt.block_device [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Attempting to driver detach volume 03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 from mountpoint /dev/vdb
Nov 14 14:35:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Attempting to detach device vdb from instance 44726e61-672d-42a1-81ae-489cb41dc49e from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:35:27 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:27 user nova-compute[75292]:   <source dev="/dev/sdh"/>
Nov 14 14:35:27 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:27 user nova-compute[75292]:   <serial>03f835e2-1b3d-4df8-9cb6-2d2df2b8b710</serial>
Nov 14 14:35:27 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:35:27 user nova-compute[75292]: </disk>
Nov 14 14:35:27 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:35:27 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Successfully detached device vdb from instance 44726e61-672d-42a1-81ae-489cb41dc49e from the persistent domain config.
Nov 14 14:35:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44726e61-672d-42a1-81ae-489cb41dc49e from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:35:27 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:27 user nova-compute[75292]:   <source dev="/dev/sdh"/>
Nov 14 14:35:27 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:27 user nova-compute[75292]:   <serial>03f835e2-1b3d-4df8-9cb6-2d2df2b8b710</serial>
Nov 14 14:35:27 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:35:27 user nova-compute[75292]: </disk>
Nov 14 14:35:27 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e445a7-f89d-4b8f-8091-e6387f8d4608]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260]
Nov 14 14:35:27 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:27 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518e707-12fc-4cb3-8363-ebe2140560e9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[45809d19-5fc3-4f0b-98a6-2c6b2aa3814d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:27 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c0cfde-f29f-49b4-bf0d-86d3884d4d4c]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiQkvLNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:35:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44726e61-672d-42a1-81ae-489cb41dc49e {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23765333062326637', 'path': '/dev/sdi'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765333062326637', 'path': '/dev/sdi'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lazy-loading 'flavor' on Instance uuid 2f019191-1147-4e62-8680-3a6cd7fcfe78 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:35:28 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:28 user nova-compute[75292]:   <source dev="/dev/sdi"/>
Nov 14 14:35:28 user nova-compute[75292]:   <target dev="sdc" bus="scsi"/>
Nov 14 14:35:28 user nova-compute[75292]:   <serial>00906fbb-144c-4f2f-809f-e635e15c7935</serial>
Nov 14 14:35:28 user nova-compute[75292]:   <address type="drive" controller="0" unit="2"/>
Nov 14 14:35:28 user nova-compute[75292]: </disk>
Nov 14 14:35:28 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No BDM found with device name sda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] No VIF found with MAC fa:16:3e:77:d3:81, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:35:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-532182d6-85d7-4a20-98a5-b96f84281a78 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.878s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:29 user nova-compute[75292]: INFO nova.compute.manager [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Detaching volume 00906fbb-144c-4f2f-809f-e635e15c7935
Nov 14 14:35:29 user nova-compute[75292]: INFO nova.virt.block_device [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Attempting to driver detach volume 00906fbb-144c-4f2f-809f-e635e15c7935 from mountpoint /dev/sdc
Nov 14 14:35:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Attempting to detach device sdc from instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:35:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:35:29 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:29 user nova-compute[75292]:   <source dev="/dev/sdi"/>
Nov 14 14:35:29 user nova-compute[75292]:   <target dev="sdc" bus="scsi"/>
Nov 14 14:35:29 user nova-compute[75292]:   <serial>00906fbb-144c-4f2f-809f-e635e15c7935</serial>
Nov 14 14:35:29 user nova-compute[75292]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 14:35:29 user nova-compute[75292]: </disk>
Nov 14 14:35:29 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:35:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Successfully detached device sdc from instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 from the persistent domain config.
Nov 14 14:35:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:35:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:35:29 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:29 user nova-compute[75292]:   <source dev="/dev/sdi"/>
Nov 14 14:35:29 user nova-compute[75292]:   <target dev="sdc" bus="scsi"/>
Nov 14 14:35:29 user nova-compute[75292]:   <serial>00906fbb-144c-4f2f-809f-e635e15c7935</serial>
Nov 14 14:35:29 user nova-compute[75292]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 14:35:29 user nova-compute[75292]: </disk>
Nov 14 14:35:29 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:35:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:31 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:31 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:31 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[94995826-e677-4197-b4ca-4a3174bcacdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:31 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1550a02-4649-441d-879a-e5061f8ea790]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a] added
Nov 14 14:35:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a71137-6bcd-49fc-9e8b-eec8be646ce4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d71e5c-10d0-4fb5-b304-75edeb8c8205]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJQFSAgu {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJQFSAgu" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6693ea-3600-47f3-b5c6-94b3baa58f27]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PJQFSAgu'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1861a8-e596-4cef-8ea6-7f3667a7486d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2c4aed-b988-4185-8e9f-47b68f73c2b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16c3a53-b564-470f-9ae7-6888d9bd52c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]
Nov 14 14:35:31 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c04ec7-eed2-49b0-b4c8-8503080b3279]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f882f-4779-45dc-99f1-627bf1fa457f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4b7fbb-aa5d-4136-97f6-9861f14a2a7d]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:35:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23938656663303861', 'path': '/dev/sdj'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938656663303861', 'path': '/dev/sdj'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:35:32 user nova-compute[75292]: DEBUG nova.objects.instance [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lazy-loading 'flavor' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:35:32 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:32 user nova-compute[75292]:   <source dev="/dev/sdj"/>
Nov 14 14:35:32 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:32 user nova-compute[75292]:   <serial>f34b87ca-9ab8-4354-abe2-d115d9d5668a</serial>
Nov 14 14:35:32 user nova-compute[75292]: </disk>
Nov 14 14:35:32 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:35:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] No VIF found with MAC fa:16:3e:6c:0b:33, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:35:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-275984d7-7bcb-43d0-9a2d-de662aac0ace tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.854s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG os_brick.utils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2372f9-9717-4775-82d9-f720e8274aba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9516b4-5c33-4c06-b0e6-f55389a60adc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a98b7f-f2f3-45c3-b89b-6657f9b0355d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6679c1a5-fb4f-492c-a6cd-df8ea6d21d1f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:34 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87d9b7-9af7-46af-862e-b0930f087d67]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:34 user nova-compute[75292]: DEBUG os_brick.utils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:35 user nova-compute[75292]: INFO nova.compute.manager [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Swapping volume f34b87ca-9ab8-4354-abe2-d115d9d5668a for 513a9464-f5db-4341-8b68-60c3c1131599
Nov 14 14:35:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXUvAlai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '092131de-273a-4410-bc2e-84f02a3e081f', 'attached_at': '', 'detached_at': '', 'volume_id': '513a9464-f5db-4341-8b68-60c3c1131599', 'serial': '513a9464-f5db-4341-8b68-60c3c1131599'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '092131de-273a-4410-bc2e-84f02a3e081f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'serial'} {{(pid=75292) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXUvAlai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:39 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:39 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:39 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db2483-3b78-40bc-8374-9dcc0d04c40a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:39 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[12417d31-bab0-480d-a268-b450f018d5ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599] added
Nov 14 14:35:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edb09f1-1225-4fd5-99a5-6b7ac543c337]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e214a89b-c47d-4e47-b868-4f2fdcbe2bb1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXUvAlai {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXUvAlai" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a7a52-6624-4e0c-8a24-bccd486746b0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXUvAlai'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e63891-60a7-4ac6-a1cd-10d9d4857124]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b34311-4969-4f4f-b7aa-3ad8ac1907ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ee7834-5bb3-420b-b33e-98b764d6cba4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260]
Nov 14 14:35:39 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb59da3-b536-4fa9-8385-f9cc9a385742]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ba2f24-04c3-42ee-be07-4e4eae935c3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2a5c5-e2ac-4bcd-8781-66c51ad37d46]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:40 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXUvAlai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:35:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26566623966653563', 'path': '/dev/sdk'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566623966653563', 'path': '/dev/sdk'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:35:40 user nova-compute[75292]: DEBUG nova.objects.instance [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lazy-loading 'flavor' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Checking UEFI support for host arch (x86_64) {{(pid=75292) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 14:35:41 user nova-compute[75292]: INFO nova.virt.libvirt.host [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] UEFI support detected
Nov 14 14:35:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 182452224 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 392167424 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-changed-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Refreshing instance network info cache due to event network-changed-1c3fced5-ac28-4e27-9f2f-86082ab39b03. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] Acquiring lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] Acquired lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG nova.network.neutron [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Refreshing network info cache for port 1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 573571072 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG nova.objects.instance [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lazy-loading 'flavor' on Instance uuid d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:43 user nova-compute[75292]: INFO nova.compute.manager [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Attaching volume b7e72e0f-746f-44ba-af48-7a54ca6b3186 to /dev/vdb
Nov 14 14:35:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updated VIF entry in instance network info cache for port 1c3fced5-ac28-4e27-9f2f-86082ab39b03. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updating instance_info_cache with network_info: [{"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ac8f18e0-7d30-42c8-8396-64d6f629f06e req-43ece289-5da7-4f73-b341-4ed6a5dbbdd5 service nova] Releasing lock "refresh_cache-d840933b-733f-435d-93cc-d83afd5e2eaa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG os_brick.utils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[615b83b6-1813-4e9b-a207-9250ef23c721]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9e2287-6808-487a-8a73-d764f7a8c3fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 718274560 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[12986242-91b0-44ec-be9c-5e5e0b5d92dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c372f25f-c2eb-4ad8-8e4b-d961b7f733ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:43 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acc5b39-6d81-4bed-8ae8-2cedeb4145ff]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG os_brick.utils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updating existing volume attachment record: 5d94d1b2-56ab-4c1c-beb7-5aa5e5d0a55a {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:35:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 869269504 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 1001390080 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:45 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826d3bb-dd90-49d1-885f-1f19897cab7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:35:45 user nova-compute[75292]: No targets found.
Nov 14 14:35:45 user nova-compute[75292]: iSNS:
Nov 14 14:35:45 user nova-compute[75292]: No targets found.
Nov 14 14:35:45 user nova-compute[75292]: STATIC:
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710
Nov 14 14:35:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:45 user nova-compute[75292]: FIRMWARE:
Nov 14 14:35:45 user nova-compute[75292]: No targets found.
Nov 14 14:35:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:35:45 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:35:45 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cbb4de-fbed-4ea9-ae90-5cac0fa264de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02167d3-49d1-46c4-976d-85085b08b805]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c294040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a'): ({'sdj'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Removing single pathed devices sdj {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[16470112-6560-4c54-a45d-232ae6e976be]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d3819-49d0-4934-83fe-e3959981ecb0]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Flushing IO for device /dev/sdj {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[777c4b7a-2421-4f74-9fb6-1953cd6f806f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.033s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7530594-aa0a-4eca-bd16-da1236f9e479]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] SCSI volumes sdj have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8278ff29-4dd3-4611-8a08-1b67824e43b5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[21753a91-f8e7-4df9-ae93-50928cc86d2a]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]
Nov 14 14:35:45 user nova-compute[75292]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dc73d2-0b8a-48ce-a75d-cd372b87bb3f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] <== disconnect_volume: return (358ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXUvAlai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '092131de-273a-4410-bc2e-84f02a3e081f', 'attached_at': '', 'detached_at': '', 'volume_id': '513a9464-f5db-4341-8b68-60c3c1131599', 'serial'} {{(pid=75292) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 14:35:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] swap_volume: removing Cinder connection for volume f34b87ca-9ab8-4354-abe2-d115d9d5668a {{(pid=75292) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] swap_volume: Updating volume f34b87ca-9ab8-4354-abe2-d115d9d5668a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SXUvAlai", "auth_password": "QyBbdPm3HRieO4", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "513a9464-f5db-4341-8b68-60c3c1131599"}, "status": "reserved", "instance": "092131de-273a-4410-bc2e-84f02a3e081f", "attached_at": "", "detached_at": "", "volume_id": "513a9464-f5db-4341-8b68-60c3c1131599", "serial": "513a9464-f5db-4341-8b68-60c3c1131599"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '513a9464-f5db-4341-8b68-60c3c1131599', 'no_device': None, 'attachment_id': 'e1b8fce5-d0e2-423c-975b-ad5ad4fbd812'} {{(pid=75292) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-963fe90d-fe67-4ac3-a5eb-c3ddd37de2ce tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.508s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG os_brick.utils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bbd543-a908-4a60-a471-2e6be8b26d26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab86883-33f7-4481-b381-6aee88831522]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2179b7c9-e369-440e-825e-ef9277cd3601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b754303-8424-4b8a-b5ce-c3513f40bc60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:47 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b68b1-b1bf-46a7-8b0b-4765e40507b6]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.utils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:47 user nova-compute[75292]: INFO nova.compute.manager [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Swapping volume 513a9464-f5db-4341-8b68-60c3c1131599 for f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "77551ead-0c38-454e-b6a6-aee54129ae69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:47 user nova-compute[75292]: INFO nova.compute.manager [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Terminating instance
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44726e61-672d-42a1-81ae-489cb41dc49e is timed out.
Nov 14 14:35:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Successfully detached device vdb from instance 44726e61-672d-42a1-81ae-489cb41dc49e from the live domain config.
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqdFvWwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:47 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[173720b1-f32f-4230-8157-0e46e6061494]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:35:47 user nova-compute[75292]: No targets found.
Nov 14 14:35:47 user nova-compute[75292]: iSNS:
Nov 14 14:35:47 user nova-compute[75292]: No targets found.
Nov 14 14:35:47 user nova-compute[75292]: STATIC:
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710
Nov 14 14:35:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:47 user nova-compute[75292]: FIRMWARE:
Nov 14 14:35:47 user nova-compute[75292]: No targets found.
Nov 14 14:35:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:35:47 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:35:47 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[650e0fb9-fa02-4c2a-b3d0-f8c9f80de51c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b93931-b24a-4a0e-a50d-cf5799e699a0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c1a35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710'): ({'sdh'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Removing single pathed devices sdh {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-7e53e1c5-fccd-4a52-a010-73a35716ab37 req-fa299e4d-7eaf-44ae-9aa6-be671d1b4d98 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-vif-unplugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7e53e1c5-fccd-4a52-a010-73a35716ab37 req-fa299e4d-7eaf-44ae-9aa6-be671d1b4d98 service nova] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7e53e1c5-fccd-4a52-a010-73a35716ab37 req-fa299e4d-7eaf-44ae-9aa6-be671d1b4d98 service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7e53e1c5-fccd-4a52-a010-73a35716ab37 req-fa299e4d-7eaf-44ae-9aa6-be671d1b4d98 service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-7e53e1c5-fccd-4a52-a010-73a35716ab37 req-fa299e4d-7eaf-44ae-9aa6-be671d1b4d98 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] No waiting events found dispatching network-vif-unplugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-7e53e1c5-fccd-4a52-a010-73a35716ab37 req-fa299e4d-7eaf-44ae-9aa6-be671d1b4d98 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-vif-unplugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[485838a7-ceff-482d-a250-cac548660a25]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fafbfba-df5e-43d1-ba08-00870dc9a1a4]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Flushing IO for device /dev/sdh {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be424e-0bc1-43e4-aa92-58bb7d2da045]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cf3e47-f815-4dcf-955a-05caa698e193]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] SCSI volumes sdh have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d685b6ad-b106-43b3-b6a2-69a7ab01a225]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Instance destroyed successfully.
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lazy-loading 'resources' on Instance uuid 77551ead-0c38-454e-b6a6-aee54129ae69 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --logout" returned: 0 in 0.127s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef506c88-9fca-4377-809b-c9b5203553de]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260]
Nov 14 14:35:47 user nova-compute[75292]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1580665728',display_name='tempest-VolumesActionsTest-instance-1580665728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1580665728',id=9,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae397a90f122425485c3b2dd48c4a83b',ramdisk_id='',reservation_id='r-0l67g1ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-52200633',owner_user_name='tempest-VolumesActionsTest-52200633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:06Z,user_data=None,user_id='6631dc16c35e4f2b990ee0c9447eaea6',uuid=77551ead-0c38-454e-b6a6-aee54129ae69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Converting VIF {"id": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "address": "fa:16:3e:22:c0:91", "network": {"id": "f7a87e7a-113b-445b-b2b8-aa30a98cf2b7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1555115097-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae397a90f122425485c3b2dd48c4a83b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc05278a-0f", "ovs_interfaceid": "cc05278a-0ff3-4def-b0d8-70fb7aa7890d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_vif [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc05278a-0f, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e2c8f5d-1809-4a9a-bba4-c0d50a953a01) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: INFO os_vif [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:91,bridge_name='br-int',has_traffic_filtering=True,id=cc05278a-0ff3-4def-b0d8-70fb7aa7890d,network=Network(f7a87e7a-113b-445b-b2b8-aa30a98cf2b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc05278a-0f')
Nov 14 14:35:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Deleting instance files /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69_del
Nov 14 14:35:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Deletion of /opt/stack/data/nova/instances/77551ead-0c38-454e-b6a6-aee54129ae69_del complete
Nov 14 14:35:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03f835e2-1b3d-4df8-9cb6-2d2df2b8b710 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3842fbd-cd2a-4193-a948-ee6da7cbfa18]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] <== disconnect_volume: return (416ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:35:48 user nova-compute[75292]: INFO nova.compute.manager [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:48 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Took 0.58 seconds to deallocate network for instance.
Nov 14 14:35:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-bdc05072-2ed9-4e6a-8145-b4d3a3e3021b req-cb54e546-e84b-4355-9bc5-969a94435e54 service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-vif-deleted-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHwofuYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:48 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:48 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:48 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f0c456-1f7d-4b90-85a6-46b7a5ddbd43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:48 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe05816-e309-406f-a7a8-bdb86d8dc9c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186] added
Nov 14 14:35:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc85bb2-ba34-49d2-878d-aab6de77f4d9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3115cca-3385-454a-8503-afc474db809d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHwofuYm {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SHwofuYm" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ef58f4-0c88-4d07-9d09-4f6b661ced76]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SHwofuYm'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[669c64d6-5d71-4c7c-b612-2ec7b32936ac]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG nova.objects.instance [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'flavor' on Instance uuid 44726e61-672d-42a1-81ae-489cb41dc49e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe3bb9-78ee-4f61-8b78-fd63e08c6951]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-963e86a7-a492-4612-8fbc-0a6e4b63e5b8 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.102s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[165fa027-cdfd-49b1-8086-c7968304963b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260]
Nov 14 14:35:49 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba499f34-5a30-4983-8338-1869c3948df9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f551f9f2-9422-4680-befe-aef20e6af113]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c983b46b-a091-46fe-abcc-a0756a70b003]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:49 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Deleted allocations for instance 77551ead-0c38-454e-b6a6-aee54129ae69
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c532874-f3e6-44bf-afcb-f18981a389d6 tempest-VolumesActionsTest-52200633 tempest-VolumesActionsTest-52200633-project-member] Lock "77551ead-0c38-454e-b6a6-aee54129ae69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.022s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-ec5b4042-779a-4679-8336-e4a043c44902 req-45841e83-805c-4cc0-954a-c8190f3ea79f service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received event network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ec5b4042-779a-4679-8336-e4a043c44902 req-45841e83-805c-4cc0-954a-c8190f3ea79f service nova] Acquiring lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ec5b4042-779a-4679-8336-e4a043c44902 req-45841e83-805c-4cc0-954a-c8190f3ea79f service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ec5b4042-779a-4679-8336-e4a043c44902 req-45841e83-805c-4cc0-954a-c8190f3ea79f service nova] Lock "77551ead-0c38-454e-b6a6-aee54129ae69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-ec5b4042-779a-4679-8336-e4a043c44902 req-45841e83-805c-4cc0-954a-c8190f3ea79f service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] No waiting events found dispatching network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:49 user nova-compute[75292]: WARNING nova.compute.manager [req-ec5b4042-779a-4679-8336-e4a043c44902 req-45841e83-805c-4cc0-954a-c8190f3ea79f service nova] [instance: 77551ead-0c38-454e-b6a6-aee54129ae69] Received unexpected event network-vif-plugged-cc05278a-0ff3-4def-b0d8-70fb7aa7890d for instance with vm_state deleted and task_state None.
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHwofuYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23861656537353037', 'path': '/dev/sdh'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861656537353037', 'path': '/dev/sdh'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.objects.instance [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lazy-loading 'flavor' on Instance uuid d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 14:35:50 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:50 user nova-compute[75292]:   <source dev="/dev/sdh"/>
Nov 14 14:35:50 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:50 user nova-compute[75292]:   <serial>b7e72e0f-746f-44ba-af48-7a54ca6b3186</serial>
Nov 14 14:35:50 user nova-compute[75292]: </disk>
Nov 14 14:35:50 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:35:50 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 is timed out.
Nov 14 14:35:50 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Successfully detached device sdc from instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 from the live domain config.
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CiQkvLNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:50 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf3798-6f03-423d-ae33-45d33bc2c0b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:35:50 user nova-compute[75292]: No targets found.
Nov 14 14:35:50 user nova-compute[75292]: iSNS:
Nov 14 14:35:50 user nova-compute[75292]: No targets found.
Nov 14 14:35:50 user nova-compute[75292]: STATIC:
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:35:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:50 user nova-compute[75292]: FIRMWARE:
Nov 14 14:35:50 user nova-compute[75292]: No targets found.
Nov 14 14:35:50 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:35:50 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:35:50 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[da277fe1-c1bf-4940-8173-4065f61d3616]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae80cd7-0144-4d67-98fc-a3a83532efa5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 (non-flash)
Nov 14 14:35:50 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5479e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935'): ({'sdi'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Removing single pathed devices sdi {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6864be5-89b0-4a49-8194-08f573e5cc95]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6341ac25-080c-4b56-bcc7-b54a29e9d7b8]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Flushing IO for device /dev/sdi {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64342d4-5bf6-46b8-9871-b29df386250a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0707f7e-669f-4637-9ca2-35130ba876d8]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] SCSI volumes sdi have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a7383c-2166-4b4e-9d80-dea8df2918db]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8176c9-4e28-4400-9c29-81cbe338e86c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260]
Nov 14 14:35:50 user nova-compute[75292]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:50 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] No VIF found with MAC fa:16:3e:2c:47:a9, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00906fbb-144c-4f2f-809f-e635e15c7935 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f55b8b6-e568-4f82-b4e4-db6b861f913c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] <== disconnect_volume: return (362ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:35:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-718ef60e-c0e2-4d2d-a256-dfc19ccb202c tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.505s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] volume_snapshot_create: create_info: {'snapshot_id': '8b432922-1c96-49ac-8f59-cb0914cf9efe', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75292) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] snap xml: <domainsnapshot>
Nov 14 14:35:51 user nova-compute[75292]:   <disks>
Nov 14 14:35:51 user nova-compute[75292]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 14 14:35:51 user nova-compute[75292]:       <source file="/dev/new_file"/>
Nov 14 14:35:51 user nova-compute[75292]:     </disk>
Nov 14 14:35:51 user nova-compute[75292]:     <disk name="vda" snapshot="no"/>
Nov 14 14:35:51 user nova-compute[75292]:   </disks>
Nov 14 14:35:51 user nova-compute[75292]: </domainsnapshot>
Nov 14 14:35:51 user nova-compute[75292]:  {{(pid=75292) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] Lazy-loading 'system_metadata' on Instance uuid d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lazy-loading 'flavor' on Instance uuid 2f019191-1147-4e62-8680-3a6cd7fcfe78 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-480353c6-865b-47c4-8e04-e03af89e8ff4 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] volume_snapshot_delete: delete_info: {'volume_id': 'b7e72e0f-746f-44ba-af48-7a54ca6b3186'} {{(pid=75292) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [None req-480353c6-865b-47c4-8e04-e03af89e8ff4 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     if delete_info['type'] != 'qcow2':
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] KeyError: 'type'
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     rv = execute(f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     six.reraise(c, e, tb)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     raise value
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     rv = meth(*args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     self._volume_snapshot_create(context, instance, guest,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     rv = execute(f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     six.reraise(c, e, tb)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     raise value
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     rv = meth(*args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] 
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fd2f76ef-3d09-4e1e-b136-2b838e821548 tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [None req-480353c6-865b-47c4-8e04-e03af89e8ff4 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-609503e4-1900-4bb2-bf06-bfbcd4efa1b5)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server [None req-480353c6-865b-47c4-8e04-e03af89e8ff4 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] Exception during message handling: KeyError: 'type'
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8b432922-1c96-49ac-8f59-cb0914cf9efe could not be found.
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8b432922-1c96-49ac-8f59-cb0914cf9efe could not be found. (HTTP 404) (Request-ID: req-bae81f6f-edc0-40fe-806c-40a3c3935e1b)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8b432922-1c96-49ac-8f59-cb0914cf9efe could not be found.
Nov 14 14:35:51 user nova-compute[75292]: ERROR nova.virt.libvirt.driver 
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server [None req-7e47cb2d-61c7-4b24-92b4-80e025595e90 tempest-VolumesAssistedSnapshotsTest-2059366417 tempest-VolumesAssistedSnapshotsTest-2059366417-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 14:35:51 user nova-compute[75292]: ERROR oslo_messaging.rpc.server 
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:51 user nova-compute[75292]: INFO nova.compute.manager [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Detaching volume b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-changed-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Refreshing instance network info cache due to event network-changed-3f4bea9a-41aa-42a2-b1ab-a71852e3e972. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] Acquiring lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] Acquired lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.network.neutron [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Refreshing network info cache for port 3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:51 user nova-compute[75292]: INFO nova.virt.block_device [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Attempting to driver detach volume b7e72e0f-746f-44ba-af48-7a54ca6b3186 from mountpoint /dev/vdb
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Attempting to detach device vdb from instance d840933b-733f-435d-93cc-d83afd5e2eaa from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 14:35:51 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:51 user nova-compute[75292]:   <source dev="/dev/sdh"/>
Nov 14 14:35:51 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:51 user nova-compute[75292]:   <serial>b7e72e0f-746f-44ba-af48-7a54ca6b3186</serial>
Nov 14 14:35:51 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:35:51 user nova-compute[75292]: </disk>
Nov 14 14:35:51 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:35:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Successfully detached device vdb from instance d840933b-733f-435d-93cc-d83afd5e2eaa from the persistent domain config.
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d840933b-733f-435d-93cc-d83afd5e2eaa from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 14:35:51 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:35:51 user nova-compute[75292]:   <source dev="/dev/sdh"/>
Nov 14 14:35:51 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:35:51 user nova-compute[75292]:   <serial>b7e72e0f-746f-44ba-af48-7a54ca6b3186</serial>
Nov 14 14:35:51 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:35:51 user nova-compute[75292]: </disk>
Nov 14 14:35:51 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '092131de-273a-4410-bc2e-84f02a3e081f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'serial': 'f34b87ca-9ab8-4354-abe2-d115d9d5668a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXUvAlai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '513a9464-f5db-4341-8b68-60c3c1131599'}, 'status': 'reserved', 'instance': '092131de-273a-4410-bc2e-84f02a3e081f', 'attached_at': '', 'detached_at': '', 'volume_id': '513a9464-f5db-4341-8b68-60c3c1131599', 'serial'} {{(pid=75292) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:51 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:51 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:51 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ea5334-5fb5-4f8f-be3e-6615d2669052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:51 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff2cabb-93a7-493f-a0d2-13d9ef6f278a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a] added
Nov 14 14:35:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf28af4e-ad45-4a56-9047-6b78bccc7546]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a28ca11-5066-4045-b7bc-ca928d821a30]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJQFSAgu {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PJQFSAgu" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5dca69-1395-4e8a-8969-c0305e187aaa]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PJQFSAgu'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d15c222-0883-4f3b-976d-ab6c1fc49207]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[88114ea3-3a9e-40cd-b807-dbc61ba24b98]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab9260f-0661-4977-b9e6-3f8cc69c35b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]
Nov 14 14:35:52 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:52 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94966e4-c75b-473d-a531-5249d207b187]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[085382a4-3c30-448b-ae02-90967c7c5aeb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:52 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1541b29c-6286-461b-b367-950ef8636073]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updated VIF entry in instance network info cache for port 3f4bea9a-41aa-42a2-b1ab-a71852e3e972. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updating instance_info_cache with network_info: [{"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2eb98d7d-3a9d-4e17-960b-0c578cc8eb7e req-92919434-6255-44ef-b764-d4e9610d1609 service nova] Releasing lock "refresh_cache-ca01398a-e681-42df-a1cb-0c89ee029386" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:52 user nova-compute[75292]: INFO nova.compute.manager [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Terminating instance
Nov 14 14:35:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-2ef77e9f-7f5c-4462-8595-d9f0d85d7087 req-4dcf24b9-190d-4bc5-8d62-afdd3e4e49d2 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-vif-unplugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2ef77e9f-7f5c-4462-8595-d9f0d85d7087 req-4dcf24b9-190d-4bc5-8d62-afdd3e4e49d2 service nova] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2ef77e9f-7f5c-4462-8595-d9f0d85d7087 req-4dcf24b9-190d-4bc5-8d62-afdd3e4e49d2 service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2ef77e9f-7f5c-4462-8595-d9f0d85d7087 req-4dcf24b9-190d-4bc5-8d62-afdd3e4e49d2 service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-2ef77e9f-7f5c-4462-8595-d9f0d85d7087 req-4dcf24b9-190d-4bc5-8d62-afdd3e4e49d2 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] No waiting events found dispatching network-vif-unplugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-2ef77e9f-7f5c-4462-8595-d9f0d85d7087 req-4dcf24b9-190d-4bc5-8d62-afdd3e4e49d2 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-vif-unplugged-b3808b25-fd92-4056-9613-50163da2a577 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23938656663303861', 'path': '/dev/sdi'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938656663303861', 'path': '/dev/sdi'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lazy-loading 'flavor' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lazy-loading 'flavor' on Instance uuid ca01398a-e681-42df-a1cb-0c89ee029386 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:53 user nova-compute[75292]: INFO nova.compute.manager [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Attaching volume 64301974-0561-4015-9781-42c690bd7525 to /dev/vdb
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.utils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2783362d-c1d0-4904-82f2-e43c5d4a162c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088e51a-5c2e-4d3c-b9ad-c3c020c1d29f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f1eab3-0c58-41e1-b81a-a9e88e68a82b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31a5391-d735-4d42-8124-61abaf900143]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:35:53 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef565529-07d8-4472-8a01-e41ab980e7f2]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_brick.utils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updating existing volume attachment record: 9d400f5d-ef0a-4daa-b613-d8f850e577eb {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:35:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Instance destroyed successfully.
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lazy-loading 'resources' on Instance uuid 2f019191-1147-4e62-8680-3a6cd7fcfe78 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1968437455',display_name='tempest-AttachSCSIVolumeTestJSON-server-1968437455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1968437455',id=6,image_ref='de803334-de11-4f75-880c-c289fa303b2f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHNLCpTmZAOMxw3MwCoS0DrHsavtwl+DcTDhLMPLQMt6V3ThKGEyLA68ZCFRI3tRf/6UnGC17wuSsDCdnqF8zk+7GbBGfCHmeYJLr6T53HnyEerk3ufRt+ScJTVfO3fAw==',key_name='tempest-keypair-46169738',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='deac54b17f774b05ab6428bc8ade6d93',ramdisk_id='',reservation_id='r-ln0cxsq5',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='de803334-de11-4f75-880c-c289fa303b2f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-733040432',owner_user_name='tempest-AttachSCSIVolumeTestJSON-733040432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:33:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88810f441446408b872009324a873ed8',uuid=2f019191-1147-4e62-8680-3a6cd7fcfe78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Converting VIF {"id": "b3808b25-fd92-4056-9613-50163da2a577", "address": "fa:16:3e:77:d3:81", "network": {"id": "0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-204842655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "deac54b17f774b05ab6428bc8ade6d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3808b25-fd", "ovs_interfaceid": "b3808b25-fd92-4056-9613-50163da2a577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG os_vif [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3808b25-fd, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 11534336 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35ebc928-f132-4aaa-97d9-397c1f0dbc35) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:53 user nova-compute[75292]: INFO os_vif [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:d3:81,bridge_name='br-int',has_traffic_filtering=True,id=b3808b25-fd92-4056-9613-50163da2a577,network=Network(0e0f5b59-efcd-4b6c-b0b1-6d6ca29e667d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3808b25-fd')
Nov 14 14:35:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Deleting instance files /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78_del
Nov 14 14:35:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Deletion of /opt/stack/data/nova/instances/2f019191-1147-4e62-8680-3a6cd7fcfe78_del complete
Nov 14 14:35:53 user nova-compute[75292]: INFO nova.compute.manager [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 14:35:53 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:35:53 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:35:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 167772160 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 324009984 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-625907c6-f6d8-4673-99c2-b68e3c04c8d6 req-298f0e46-67af-487f-9239-15ee215fd460 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-625907c6-f6d8-4673-99c2-b68e3c04c8d6 req-298f0e46-67af-487f-9239-15ee215fd460 service nova] Acquiring lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-625907c6-f6d8-4673-99c2-b68e3c04c8d6 req-298f0e46-67af-487f-9239-15ee215fd460 service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-625907c6-f6d8-4673-99c2-b68e3c04c8d6 req-298f0e46-67af-487f-9239-15ee215fd460 service nova] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-625907c6-f6d8-4673-99c2-b68e3c04c8d6 req-298f0e46-67af-487f-9239-15ee215fd460 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] No waiting events found dispatching network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:55 user nova-compute[75292]: WARNING nova.compute.manager [req-625907c6-f6d8-4673-99c2-b68e3c04c8d6 req-298f0e46-67af-487f-9239-15ee215fd460 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received unexpected event network-vif-plugged-b3808b25-fd92-4056-9613-50163da2a577 for instance with vm_state active and task_state deleting.
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 429916160 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-77bec175-fd5b-47c8-aba6-dbb495fda218 req-06c3841e-f2f6-43ef-89df-f5748d5c6e58 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Received event network-vif-deleted-b3808b25-fd92-4056-9613-50163da2a577 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:55 user nova-compute[75292]: INFO nova.compute.manager [req-77bec175-fd5b-47c8-aba6-dbb495fda218 req-06c3841e-f2f6-43ef-89df-f5748d5c6e58 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Neutron deleted interface b3808b25-fd92-4056-9613-50163da2a577; detaching it from the instance and deleting it from the info cache
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-77bec175-fd5b-47c8-aba6-dbb495fda218 req-06c3841e-f2f6-43ef-89df-f5748d5c6e58 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:55 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Took 1.72 seconds to deallocate network for instance.
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-77bec175-fd5b-47c8-aba6-dbb495fda218 req-06c3841e-f2f6-43ef-89df-f5748d5c6e58 service nova] [instance: 2f019191-1147-4e62-8680-3a6cd7fcfe78] Detach interface failed, port_id=b3808b25-fd92-4056-9613-50163da2a577, reason: Instance 2f019191-1147-4e62-8680-3a6cd7fcfe78 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 526385152 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-changed-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing instance network info cache due to event network-changed-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] Acquiring lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] Acquired lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:35:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Refreshing network info cache for port 5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 706740224 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:56 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Deleted allocations for instance 2f019191-1147-4e62-8680-3a6cd7fcfe78
Nov 14 14:35:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e489af3-1a98-46bb-aa67-49ef64bb5e3d tempest-AttachSCSIVolumeTestJSON-733040432 tempest-AttachSCSIVolumeTestJSON-733040432-project-member] Lock "2f019191-1147-4e62-8680-3a6cd7fcfe78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.840s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 866123776 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG nova.network.neutron [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updated VIF entry in instance network info cache for port 5987ebf3-7ab4-4bfe-a617-03d5fb4a5473. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG nova.network.neutron [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:35:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6db111a4-7a18-48b8-b891-c922552f8d08 req-655274e7-4a7c-4b0e-9821-eecbb04eab71 service nova] Releasing lock "refresh_cache-b6d0c21e-94fd-4a61-8f05-884727be61d2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:35:57 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 1044381696 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:57 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXUvAlai', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': '513a9464-f5db-4341-8b68-60c3c1131599'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:58 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70d4271-365d-4fc3-ab4b-2e3e9e5cd791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:35:58 user nova-compute[75292]: No targets found.
Nov 14 14:35:58 user nova-compute[75292]: iSNS:
Nov 14 14:35:58 user nova-compute[75292]: No targets found.
Nov 14 14:35:58 user nova-compute[75292]: STATIC:
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:35:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:35:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:35:58 user nova-compute[75292]: FIRMWARE:
Nov 14 14:35:58 user nova-compute[75292]: No targets found.
Nov 14 14:35:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:35:58 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:35:58 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd8edd8-953a-4bab-a8fb-523e261ef824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f486b5ed-124a-4c84-b22a-c335fc7505eb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:35:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542ad870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599'): ({'sdk'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Removing single pathed devices sdk {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d839fdad-f88e-4f87-895b-5c5eb818afd4]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8983c-97df-4834-9acd-3bebfebcc515]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Flushing IO for device /dev/sdk {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.011s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5656fdc-f06d-40a4-a8ce-3827abc90aeb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.039s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[686da0db-9a19-4e92-b61b-e64932b158dc]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] SCSI volumes sdk have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c18e03-f5a6-4012-9cd9-fb1e31d4eada]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e511d-6ed0-4398-b35b-772f01e9b8ae]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260]
Nov 14 14:35:58 user nova-compute[75292]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599, portal: 172.16.0.220,3260] successful.
Nov 14 14:35:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:513a9464-f5db-4341-8b68-60c3c1131599 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[39575e15-6b11-483e-aa80-dd9488d5ba26]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] <== disconnect_volume: return (359ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '092131de-273a-4410-bc2e-84f02a3e081f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'serial'} {{(pid=75292) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] swap_volume: removing Cinder connection for volume 513a9464-f5db-4341-8b68-60c3c1131599 {{(pid=75292) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 14:35:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:59 user nova-compute[75292]: INFO nova.compute.manager [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Terminating instance
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a7f8170-7652-409d-9238-f402a67e3c99 req-634ed577-5baa-4de9-9d76-6fd8f1147a41 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a7f8170-7652-409d-9238-f402a67e3c99 req-634ed577-5baa-4de9-9d76-6fd8f1147a41 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a7f8170-7652-409d-9238-f402a67e3c99 req-634ed577-5baa-4de9-9d76-6fd8f1147a41 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a7f8170-7652-409d-9238-f402a67e3c99 req-634ed577-5baa-4de9-9d76-6fd8f1147a41 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a7f8170-7652-409d-9238-f402a67e3c99 req-634ed577-5baa-4de9-9d76-6fd8f1147a41 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a7f8170-7652-409d-9238-f402a67e3c99 req-634ed577-5baa-4de9-9d76-6fd8f1147a41 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] swap_volume: Updating volume 513a9464-f5db-4341-8b68-60c3c1131599 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PJQFSAgu", "auth_password": "eqsVLPuovD4nfA", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "f34b87ca-9ab8-4354-abe2-d115d9d5668a"}, "status": "reserved", "instance": "092131de-273a-4410-bc2e-84f02a3e081f", "attached_at": "", "detached_at": "", "volume_id": "f34b87ca-9ab8-4354-abe2-d115d9d5668a", "serial": "f34b87ca-9ab8-4354-abe2-d115d9d5668a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'no_device': None, 'attachment_id': '40f3e7ba-450c-408e-b96e-83d8fa3ebf55'} {{(pid=75292) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7d5b729-54b9-4285-9910-6fbcfece700b tempest-TestVolumeSwap-1822926363 tempest-TestVolumeSwap-1822926363-project-admin] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.523s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-587d65b4-2596-48bf-8caf-2be536ea7b1a req-37f48bdd-c5ef-4fd1-b82c-55d399faf8d2 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-587d65b4-2596-48bf-8caf-2be536ea7b1a req-37f48bdd-c5ef-4fd1-b82c-55d399faf8d2 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-587d65b4-2596-48bf-8caf-2be536ea7b1a req-37f48bdd-c5ef-4fd1-b82c-55d399faf8d2 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-587d65b4-2596-48bf-8caf-2be536ea7b1a req-37f48bdd-c5ef-4fd1-b82c-55d399faf8d2 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-587d65b4-2596-48bf-8caf-2be536ea7b1a req-37f48bdd-c5ef-4fd1-b82c-55d399faf8d2 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-587d65b4-2596-48bf-8caf-2be536ea7b1a req-37f48bdd-c5ef-4fd1-b82c-55d399faf8d2 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:35:59 user nova-compute[75292]: INFO nova.compute.manager [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Terminating instance
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXgZPKvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:35:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:35:59 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac3669-89b4-441b-b5c4-342e6f21c0fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:35:59 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c40475-9b35-4f86-b5d3-f3f8827ce562]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525] added
Nov 14 14:35:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66a7bd-1e6e-48d7-b7cc-7ab2a7029108]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94f7ec3-fd7e-4194-8c74-c6ca31d53b53]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXgZPKvF {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXgZPKvF" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9071bd-7e34-42f3-bb4a-8dc9161e16f6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXgZPKvF'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:35:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b594315c-e573-44d1-9ddf-2e489d2b2792]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2531c1aa-f1eb-423c-938d-0709eeb4b16d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-d401cde7-26a7-4d87-9120-d9e64621432b req-b9b9618f-0e34-48ac-8128-264651e22a63 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d401cde7-26a7-4d87-9120-d9e64621432b req-b9b9618f-0e34-48ac-8128-264651e22a63 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d401cde7-26a7-4d87-9120-d9e64621432b req-b9b9618f-0e34-48ac-8128-264651e22a63 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d401cde7-26a7-4d87-9120-d9e64621432b req-b9b9618f-0e34-48ac-8128-264651e22a63 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-d401cde7-26a7-4d87-9120-d9e64621432b req-b9b9618f-0e34-48ac-8128-264651e22a63 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-d401cde7-26a7-4d87-9120-d9e64621432b req-b9b9618f-0e34-48ac-8128-264651e22a63 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-d584e823-31d5-4103-9d86-2377985e207a for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b199ac-1a72-44b5-aec2-effff901d5a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260]
Nov 14 14:36:00 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:00 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37518e4e-dad4-4fc9-923d-a18a00a44811]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c931e58-265b-49c8-94e4-e630f2fe4ca3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:00 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1389a0e6-fd66-44a5-b133-aadec1fc2fed]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:00 user nova-compute[75292]: INFO nova.compute.manager [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Detaching volume f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXgZPKvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:36:00 user nova-compute[75292]: INFO nova.virt.block_device [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Attempting to driver detach volume f34b87ca-9ab8-4354-abe2-d115d9d5668a from mountpoint /dev/vdb
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Attempting to detach device vdb from instance 092131de-273a-4410-bc2e-84f02a3e081f from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:36:00 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:36:00 user nova-compute[75292]:   <source dev="/dev/sdi"/>
Nov 14 14:36:00 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:36:00 user nova-compute[75292]:   <serial>f34b87ca-9ab8-4354-abe2-d115d9d5668a</serial>
Nov 14 14:36:00 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:36:00 user nova-compute[75292]: </disk>
Nov 14 14:36:00 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:36:00 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Successfully detached device vdb from instance 092131de-273a-4410-bc2e-84f02a3e081f from the persistent domain config.
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 092131de-273a-4410-bc2e-84f02a3e081f from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:36:00 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:36:00 user nova-compute[75292]:   <source dev="/dev/sdi"/>
Nov 14 14:36:00 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:36:00 user nova-compute[75292]:   <serial>f34b87ca-9ab8-4354-abe2-d115d9d5668a</serial>
Nov 14 14:36:00 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:36:00 user nova-compute[75292]: </disk>
Nov 14 14:36:00 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23735396664353266', 'path': '/dev/sdj'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735396664353266', 'path': '/dev/sdj'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lazy-loading 'flavor' on Instance uuid ca01398a-e681-42df-a1cb-0c89ee029386 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:36:01 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:36:01 user nova-compute[75292]:   <source dev="/dev/sdj"/>
Nov 14 14:36:01 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:36:01 user nova-compute[75292]:   <serial>64301974-0561-4015-9781-42c690bd7525</serial>
Nov 14 14:36:01 user nova-compute[75292]: </disk>
Nov 14 14:36:01 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:36:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Instance destroyed successfully.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lazy-loading 'resources' on Instance uuid 3da9a112-00f0-4ed8-a135-4a35ba0b4233 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1031028445',display_name='tempest-VolumesActionsTest-instance-1031028445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1031028445',id=12,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a8c84debb904cc5b4798f3abc42c05e',ramdisk_id='',reservation_id='r-wduim00j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1975132646',owner_user_name='tempest-VolumesActionsTest-1975132646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:18Z,user_data=None,user_id='eaeef475e0554905982ae3762b4e1be6',uuid=3da9a112-00f0-4ed8-a135-4a35ba0b4233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converting VIF {"id": "6fc76e37-cc0f-47f0-846f-287359c36f57", "address": "fa:16:3e:96:f2:2e", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc76e37-cc", "ovs_interfaceid": "6fc76e37-cc0f-47f0-846f-287359c36f57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_vif [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fc76e37-cc, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Instance destroyed successfully.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lazy-loading 'resources' on Instance uuid b6d0c21e-94fd-4a61-8f05-884727be61d2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: WARNING nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 for instance with vm_state active and task_state deleting.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: WARNING nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-e080b518-6cf3-4608-abf2-8b2c4f5fa7f9 for instance with vm_state active and task_state deleting.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: WARNING nova.compute.manager [req-a1bdc52b-f6d1-4cef-82e6-4e3e85af4259 req-5b64b4a4-b7be-42db-b9ba-c33b42457050 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8 for instance with vm_state active and task_state deleting.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5987ebf3-7a, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38fc611f-d81b-4c45-b03a-65fc5f318145) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f26cca1-4ffa-4afb-9125-a5c37d817321) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: INFO os_vif [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f2:2e,bridge_name='br-int',has_traffic_filtering=True,id=6fc76e37-cc0f-47f0-846f-287359c36f57,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc76e37-cc')
Nov 14 14:36:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Deleting instance files /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233_del
Nov 14 14:36:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Deletion of /opt/stack/data/nova/instances/3da9a112-00f0-4ed8-a135-4a35ba0b4233_del complete
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:4d:23,bridge_name='br-int',has_traffic_filtering=True,id=5987ebf3-7ab4-4bfe-a617-03d5fb4a5473,network=Network(9337d23b-856c-4c29-aa10-e0a11fefd5e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5987ebf3-7a')
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape080b518-6c, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: INFO nova.compute.manager [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Took 1.89 seconds to destroy the instance on the hypervisor.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80dab7e1-f14a-49cb-85f9-359bbe942100) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] No VIF found with MAC fa:16:3e:25:73:52, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b9:ba,bridge_name='br-int',has_traffic_filtering=True,id=e080b518-6cf3-4608-abf2-8b2c4f5fa7f9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape080b518-6c')
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4b185b-6e, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: WARNING nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-cbc05e66-34c2-4cd9-b085-8248d987d5b9 for instance with vm_state active and task_state deleting.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: WARNING nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-cc33ef60-cf8d-4f49-bae3-333d15c4071d for instance with vm_state active and task_state deleting.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-unplugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-unplugged-0d226182-76b0-42c1-970f-556bdacc439c for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:01 user nova-compute[75292]: WARNING nova.compute.manager [req-234aa0a7-0e81-4fd7-9d17-860bcb3cbba5 req-f5a44460-8f9f-4f19-b48e-b2d2947924ff service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-0d226182-76b0-42c1-970f-556bdacc439c for instance with vm_state active and task_state deleting.
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e923172-91d1-4e69-b0dc-c55d95095d7c) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:d0:bf,bridge_name='br-int',has_traffic_filtering=True,id=6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e4b185b-6e')
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbc05e66-34, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d3ae819e-878e-4d0b-b4dc-f78813032360 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.354s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72a29837-42cc-4b3c-b577-ace316012b35) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:40:cf,bridge_name='br-int',has_traffic_filtering=True,id=cbc05e66-34c2-4cd9-b085-8248d987d5b9,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc05e66-34')
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "address": "fa:16:3e:6b:80:8a", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.38", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc33ef60-cf", "ovs_interfaceid": "cc33ef60-cf8d-4f49-bae3-333d15c4071d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc33ef60-cf, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77bd9359-ea69-4bb4-bdbb-c255d8949d08) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:80:8a,bridge_name='br-int',has_traffic_filtering=True,id=cc33ef60-cf8d-4f49-bae3-333d15c4071d,network=Network(f682e83c-e311-4c52-a6cf-a6d791a57dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc33ef60-cf')
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d226182-76, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cd2d44e-5865-4363-9dcf-c486a28c31c4) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:be:97,bridge_name='br-int',has_traffic_filtering=True,id=0d226182-76b0-42c1-970f-556bdacc439c,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d226182-76')
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244288722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244288722',id=11,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1YJtyUBFJfqz5plon8Lbf4W/AWN0uZJQ+NWo621CzR2c+qLI/wC2UBBObgTypIBhwCXHvST8Q3mhe6fuoZVF2d2QrZ0Nf2SpmXYGIP8yLe4TSKLR/DDIlg0RvpVB0ClQ==',key_name='tempest-keypair-146884016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e71daa8dc5654960a8403aaf6524eb83',ramdisk_id='',reservation_id='r-lov6ona0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-412349485',owner_user_name='tempest-TaggedBootDevicesTest_v242-412349485-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b6897285dad4ce0a5fa36a4bbe55faf',uuid=b6d0c21e-94fd-4a61-8f05-884727be61d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converting VIF {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd584e823-31, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70e4a3a7-07ee-4856-823c-9f553aa87110) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:02 user nova-compute[75292]: INFO os_vif [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a8:91,bridge_name='br-int',has_traffic_filtering=True,id=d584e823-31d5-4103-9d86-2377985e207a,network=Network(b499a434-f06f-44f6-8f14-9353ec01cd3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd584e823-31')
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcladKTR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a798ca-db87-4d7f-9501-3da6e5793f03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]: iSNS:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]: STATIC:
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:02 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:02 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[446db73f-e87f-4e23-b2e3-37a1628f28f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Acquiring lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] No waiting events found dispatching network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:02 user nova-compute[75292]: WARNING nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received unexpected event network-vif-plugged-d584e823-31d5-4103-9d86-2377985e207a for instance with vm_state active and task_state deleting.
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-vif-unplugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] No waiting events found dispatching network-vif-unplugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-vif-unplugged-6fc76e37-cc0f-47f0-846f-287359c36f57 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Acquiring lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] No waiting events found dispatching network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:02 user nova-compute[75292]: WARNING nova.compute.manager [req-8cfc2f0f-1725-4dce-865e-578a5aef715d req-a9a22f40-4b0c-4150-abb3-50c74bef7b6c service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received unexpected event network-vif-plugged-6fc76e37-cc0f-47f0-846f-287359c36f57 for instance with vm_state active and task_state deleting.
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c00f711-c7b0-4286-83e8-da3c47bd3bbf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542c1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4'): ({'sdf'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Removing single pathed devices sdf {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c596580-3cb3-4705-a358-555f86ec5068]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1839a66-3a55-4267-b400-164d246ec6ad]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Flushing IO for device /dev/sdf {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426feda-b07e-40fb-a455-767d36151a00]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[742dbed9-1e35-42bc-92dd-65378053981f]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c41022-262c-4fa0-b0d5-a8404aeab194]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aebe9c-13ed-4d21-80fb-59cd43935d30]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260]
Nov 14 14:36:02 user nova-compute[75292]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a823006-581f-45c1-86a6-6158ca9ffed4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b1acec-204c-4a1e-ab7d-f127ce5bd11a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== disconnect_volume: return (384ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTZCDLgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:02 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Took 0.80 seconds to deallocate network for instance.
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b1f57e-9701-498b-bd61-1dd836f18805]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]: iSNS:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]: STATIC:
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:02 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:02 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3750af85-8cf9-400f-93fa-3ffffd284d33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9580e3da-f073-41ca-8030-70f58d96ced4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c3d3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea'): ({'sdd'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Removing single pathed devices sdd {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[12923943-8796-4ed0-be39-0aba48ed9fb8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd4359c-21bf-4276-a33e-5557c0f2bfad]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Flushing IO for device /dev/sdd {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58eb61f-f4f2-4de9-a957-249f85e8633f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[934828e2-4d62-4dfc-b60e-1f1076ce0c78]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6477c-2708-4d40-8707-be4903c73ead]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f41c91a-6b7c-47be-853a-629937e9fcb4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260]
Nov 14 14:36:02 user nova-compute[75292]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c04f8-8a6c-42d8-bb62-bfc7298fe1ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[518bf142-ccd5-4cdd-8496-c15308594a61]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== disconnect_volume: return (367ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJfxQzDS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1be5677-3bf6-41f2-b861-93fbd3776635]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]: iSNS:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]: STATIC:
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:02 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:02 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:02 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:02 user nova-compute[75292]: No targets found.
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:02 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:02 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbbc7c9-8edd-4585-bbc9-c05723c45dfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1757ed-3cbb-43a0-9518-d8a5956c1e79]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:02 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542c0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a128440-186c-49f5-a6b1-db539c4cd869]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06225575-8c30-4c74-aaf0-cdf98a1a136b]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6776a9-6c83-4a4e-98e2-736e99b6f079]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:03 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Deleted allocations for instance 3da9a112-00f0-4ed8-a135-4a35ba0b4233
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7aa7d-0613-46e3-846b-e02de5bba1b7]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fc6d67-ee45-4aba-8827-33a44a6d2d1f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a318d3a0-2489-4cdc-8624-c18aa6a9d643 tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "3da9a112-00f0-4ed8-a135-4a35ba0b4233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.331s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ee1231-e2e6-4b60-95cb-42d2b45ad596]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260]
Nov 14 14:36:03 user nova-compute[75292]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:03 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaa1646a-8a52-4bf2-856a-50822a6f2988 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b674dd-19c4-4522-a13c-a090b43edd96]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] <== disconnect_volume: return (339ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Deleting instance files /opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2_del
Nov 14 14:36:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Deletion of /opt/stack/data/nova/instances/b6d0c21e-94fd-4a61-8f05-884727be61d2_del complete
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:36:03 user nova-compute[75292]: INFO nova.compute.manager [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Took 4.22 seconds to destroy the instance on the hypervisor.
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:03 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-changed-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing instance network info cache due to event network-changed-8fd16284-1189-4ea5-a96f-30b7853b8521. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] Acquiring lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] Acquired lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Refreshing network info cache for port 8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:04 user nova-compute[75292]: INFO nova.compute.manager [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Detaching volume 64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:04 user nova-compute[75292]: INFO nova.virt.block_device [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Attempting to driver detach volume 64301974-0561-4015-9781-42c690bd7525 from mountpoint /dev/vdb
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Attempting to detach device vdb from instance ca01398a-e681-42df-a1cb-0c89ee029386 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:36:04 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:36:04 user nova-compute[75292]:   <source dev="/dev/sdj"/>
Nov 14 14:36:04 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:36:04 user nova-compute[75292]:   <serial>64301974-0561-4015-9781-42c690bd7525</serial>
Nov 14 14:36:04 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:36:04 user nova-compute[75292]: </disk>
Nov 14 14:36:04 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:36:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Successfully detached device vdb from instance ca01398a-e681-42df-a1cb-0c89ee029386 from the persistent domain config.
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca01398a-e681-42df-a1cb-0c89ee029386 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:36:04 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:36:04 user nova-compute[75292]:   <source dev="/dev/sdj"/>
Nov 14 14:36:04 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:36:04 user nova-compute[75292]:   <serial>64301974-0561-4015-9781-42c690bd7525</serial>
Nov 14 14:36:04 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:36:04 user nova-compute[75292]: </disk>
Nov 14 14:36:04 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updated VIF entry in instance network info cache for port 8fd16284-1189-4ea5-a96f-30b7853b8521. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] Releasing lock "refresh_cache-c2c1c552-a700-4429-b258-7d662389822a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-c36af445-ab2a-42b0-bf8a-ded4a78fa85e req-ceee4955-173a-4444-92fe-6f22e357a015 service nova] [instance: 3da9a112-00f0-4ed8-a135-4a35ba0b4233] Received event network-vif-deleted-6fc76e37-cc0f-47f0-846f-287359c36f57 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca01398a-e681-42df-a1cb-0c89ee029386 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-43ef3cdb-c3d7-476d-9803-edce9925e680 req-60ace913-884f-4159-8287-9a95b31385f4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-deleted-cc33ef60-cf8d-4f49-bae3-333d15c4071d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:05 user nova-compute[75292]: INFO nova.compute.manager [req-43ef3cdb-c3d7-476d-9803-edce9925e680 req-60ace913-884f-4159-8287-9a95b31385f4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Neutron deleted interface cc33ef60-cf8d-4f49-bae3-333d15c4071d; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-43ef3cdb-c3d7-476d-9803-edce9925e680 req-60ace913-884f-4159-8287-9a95b31385f4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "address": "fa:16:3e:1f:40:cf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc05e66-34", "ovs_interfaceid": "cbc05e66-34c2-4cd9-b085-8248d987d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-43ef3cdb-c3d7-476d-9803-edce9925e680 req-60ace913-884f-4159-8287-9a95b31385f4 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Detach interface failed, port_id=cc33ef60-cf8d-4f49-bae3-333d15c4071d, reason: Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "c2c1c552-a700-4429-b258-7d662389822a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:05 user nova-compute[75292]: INFO nova.compute.manager [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Terminating instance
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-dcf943a5-f40f-4fbc-826e-6cd86e2f3ec9 req-ed9cdcf3-a6f3-4d57-a087-4b5ad0aaf8b6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dcf943a5-f40f-4fbc-826e-6cd86e2f3ec9 req-ed9cdcf3-a6f3-4d57-a087-4b5ad0aaf8b6 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dcf943a5-f40f-4fbc-826e-6cd86e2f3ec9 req-ed9cdcf3-a6f3-4d57-a087-4b5ad0aaf8b6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dcf943a5-f40f-4fbc-826e-6cd86e2f3ec9 req-ed9cdcf3-a6f3-4d57-a087-4b5ad0aaf8b6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-dcf943a5-f40f-4fbc-826e-6cd86e2f3ec9 req-ed9cdcf3-a6f3-4d57-a087-4b5ad0aaf8b6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-dcf943a5-f40f-4fbc-826e-6cd86e2f3ec9 req-ed9cdcf3-a6f3-4d57-a087-4b5ad0aaf8b6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-8fd16284-1189-4ea5-a96f-30b7853b8521 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-7f5bf581-9298-4794-9f5a-2f6bf7fad0eb req-52e1e3ec-9203-4169-8fbf-bf863f91b603 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7f5bf581-9298-4794-9f5a-2f6bf7fad0eb req-52e1e3ec-9203-4169-8fbf-bf863f91b603 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7f5bf581-9298-4794-9f5a-2f6bf7fad0eb req-52e1e3ec-9203-4169-8fbf-bf863f91b603 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7f5bf581-9298-4794-9f5a-2f6bf7fad0eb req-52e1e3ec-9203-4169-8fbf-bf863f91b603 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-7f5bf581-9298-4794-9f5a-2f6bf7fad0eb req-52e1e3ec-9203-4169-8fbf-bf863f91b603 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-7f5bf581-9298-4794-9f5a-2f6bf7fad0eb req-52e1e3ec-9203-4169-8fbf-bf863f91b603 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-2d90409f-283d-4e5d-af84-252cb61a50ad for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c2c1c552-a700-4429-b258-7d662389822a] Instance destroyed successfully.
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lazy-loading 'resources' on Instance uuid c2c1c552-a700-4429-b258-7d662389822a {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fd16284-11, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90388932-cbca-428a-ba16-f4c3b85a381d) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:e2:dd,bridge_name='br-int',has_traffic_filtering=True,id=8fd16284-1189-4ea5-a96f-30b7853b8521,network=Network(d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fd16284-11')
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa51bd563-fd, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87684479-4d1e-4e24-8526-d82fe09ef302) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:bd:0b,bridge_name='br-int',has_traffic_filtering=True,id=a51bd563-fde7-4660-aded-2a341093c9c1,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa51bd563-fd')
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0265d5b-95, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89634e2b-24b1-48d0-b662-f369a7abaa76) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-deleted-cbc05e66-34c2-4cd9-b085-8248d987d5b9 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: INFO nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Neutron deleted interface cbc05e66-34c2-4cd9-b085-8248d987d5b9; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d584e823-31d5-4103-9d86-2377985e207a", "address": "fa:16:3e:bf:a8:91", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd584e823-31", "ovs_interfaceid": "d584e823-31d5-4103-9d86-2377985e207a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:27:b2,bridge_name='br-int',has_traffic_filtering=True,id=c0265d5b-9575-43b8-9364-cbc3bca906e5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0265d5b-95')
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab32bf5e-85, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Detach interface failed, port_id=cbc05e66-34c2-4cd9-b085-8248d987d5b9, reason: Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:07 user nova-compute[75292]: WARNING nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-c0265d5b-9575-43b8-9364-cbc3bca906e5 for instance with vm_state active and task_state deleting.
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-deleted-d584e823-31d5-4103-9d86-2377985e207a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: INFO nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Neutron deleted interface d584e823-31d5-4103-9d86-2377985e207a; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d226182-76b0-42c1-970f-556bdacc439c", "address": "fa:16:3e:12:be:97", "network": {"id": "b499a434-f06f-44f6-8f14-9353ec01cd3e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1833939556", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d226182-76", "ovs_interfaceid": "0d226182-76b0-42c1-970f-556bdacc439c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09ef1ba2-e75a-4e25-b9a4-35fd5f431416) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Detach interface failed, port_id=d584e823-31d5-4103-9d86-2377985e207a, reason: Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:07 user nova-compute[75292]: WARNING nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-ab32bf5e-858b-4989-adbf-1bacc0a61d82 for instance with vm_state active and task_state deleting.
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-deleted-0d226182-76b0-42c1-970f-556bdacc439c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: INFO nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Neutron deleted interface 0d226182-76b0-42c1-970f-556bdacc439c; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [{"id": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "address": "fa:16:3e:06:4d:23", "network": {"id": "9337d23b-856c-4c29-aa10-e0a11fefd5e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1630940842-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5987ebf3-7a", "ovs_interfaceid": "5987ebf3-7ab4-4bfe-a617-03d5fb4a5473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "address": "fa:16:3e:34:b9:ba", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape080b518-6c", "ovs_interfaceid": "e080b518-6cf3-4608-abf2-8b2c4f5fa7f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "address": "fa:16:3e:b1:d0:bf", "network": {"id": "f682e83c-e311-4c52-a6cf-a6d791a57dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-1743645044", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e71daa8dc5654960a8403aaf6524eb83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4b185b-6e", "ovs_interfaceid": "6e4b185b-6eeb-4ec1-bac4-c8703ad02ce8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=ab32bf5e-858b-4989-adbf-1bacc0a61d82,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab32bf5e-85')
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8caca002-bd, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Detach interface failed, port_id=0d226182-76b0-42c1-970f-556bdacc439c, reason: Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d518a0ba-eaaa-42d5-9db3-61b7c35534b5 req-4954d282-d959-45ea-bf8a-28e7bd2ba1f6 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-8caca002-bd65-462d-a092-04e12e9ba1b5 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bb5b64b-5368-4d96-bf42-358bbaefe4f1) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:07 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:88:f6,bridge_name='br-int',has_traffic_filtering=True,id=8caca002-bd65-462d-a092-04e12e9ba1b5,network=Network(6af3dbd6-62fe-4fd3-b86e-d19e59b2c813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8caca002-bd')
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "address": "fa:16:3e:da:a2:59", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15fbf7b7-f7", "ovs_interfaceid": "15fbf7b7-f7a5-4703-9848-648aa5f590d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:07 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15fbf7b7-f7, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-8fd16284-1189-4ea5-a96f-30b7853b8521 for instance with vm_state active and task_state deleting.
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-a51bd563-fde7-4660-aded-2a341093c9c1 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-a51bd563-fde7-4660-aded-2a341093c9c1 for instance with vm_state active and task_state deleting.
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-unplugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-unplugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING nova.compute.manager [req-0cdeea5b-291e-4683-a758-9d812a18e36b req-63f51e39-a8c1-416e-b46e-141c04305f7b service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-15fbf7b7-f7a5-4703-9848-648aa5f590d3 for instance with vm_state active and task_state deleting.
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2997abc0-2241-4eb8-aa58-f4c6ac498c07) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:36:08 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7174MB free_disk=25.575172424316406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:08 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:a2:59,bridge_name='br-int',has_traffic_filtering=True,id=15fbf7b7-f7a5-4703-9848-648aa5f590d3,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15fbf7b7-f7')
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-668574330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-668574330',id=13,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG55m3KqYsZGSQB0kZBBDHPUZhcQCssk33gJT1/q9+MX4BRjzzfIcc8Ok1W6gYHDmOHA2eUa5plSDHzDpZZHCG6OS7LVnvzQFPavvGLd3YCrVLg5wO42++ovwWpDToB5YQ==',key_name='tempest-keypair-342145264',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b963127017714c239656e80b2af9243f',ramdisk_id='',reservation_id='r-sk2ps23l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-479327237',owner_user_name='tempest-TaggedBootDevicesTest-479327237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adb08a17466e441e9a300c627a840bf9',uuid=c2c1c552-a700-4429-b258-7d662389822a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converting VIF {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d90409f-28, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Took 4.83 seconds to deallocate network for instance.
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30d182ec-4374-4f49-a407-0b21a03ade78) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:08 user nova-compute[75292]: INFO os_vif [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:ef:b4,bridge_name='br-int',has_traffic_filtering=True,id=2d90409f-283d-4e5d-af84-252cb61a50ad,network=Network(402d120b-7d78-46d8-94be-e7d585be2c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d90409f-28')
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXpcLnMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23b8bc4-b728-412d-8e6a-4c3a94dbc34d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]: iSNS:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]: STATIC:
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:08 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:08 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff617307-ef3e-468d-8ff0-cf923fb1dcd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e460514-0cd7-41b2-8e81-5d80a9f1c6c5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b54333d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 44726e61-672d-42a1-81ae-489cb41dc49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 092131de-273a-4410-bc2e-84f02a3e081f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance d840933b-733f-435d-93cc-d83afd5e2eaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ca01398a-e681-42df-a1cb-0c89ee029386 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b6d0c21e-94fd-4a61-8f05-884727be61d2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c2c1c552-a700-4429-b258-7d662389822a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f6671a-f94a-41b8-a611-f27daad2b905]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc21f81b-7596-49b4-b4ae-c05acd16ec38]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bf4111-1ab1-4896-9a65-f209d82f2ad4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae8d057-4313-4c56-876b-cb973e278373]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0745518d-b6bc-4d9b-9521-c2ff10bbe135]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb4c8f4-c6ea-4d7c-b6e0-0c9f1623476f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260]
Nov 14 14:36:08 user nova-compute[75292]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a2c4473-e6b4-4d46-9e3a-ed5996ce837e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c2de70-8238-4e7d-8388-1d8a97f8c127]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== disconnect_volume: return (330ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rCiwclyQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-5b3ce9d9-ed93-42a0-88e6-e1e8a3f9a941 req-81ae4eeb-cc4d-496d-9e88-7100a4e92378 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5b3ce9d9-ed93-42a0-88e6-e1e8a3f9a941 req-81ae4eeb-cc4d-496d-9e88-7100a4e92378 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5b3ce9d9-ed93-42a0-88e6-e1e8a3f9a941 req-81ae4eeb-cc4d-496d-9e88-7100a4e92378 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5b3ce9d9-ed93-42a0-88e6-e1e8a3f9a941 req-81ae4eeb-cc4d-496d-9e88-7100a4e92378 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-5b3ce9d9-ed93-42a0-88e6-e1e8a3f9a941 req-81ae4eeb-cc4d-496d-9e88-7100a4e92378 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING nova.compute.manager [req-5b3ce9d9-ed93-42a0-88e6-e1e8a3f9a941 req-81ae4eeb-cc4d-496d-9e88-7100a4e92378 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-2d90409f-283d-4e5d-af84-252cb61a50ad for instance with vm_state active and task_state deleting.
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd2ba3a-7523-4be0-bd3e-570469c427fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]: iSNS:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]: STATIC:
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:08 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:08 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b10814-4c69-48ae-97ad-a96f88e69016]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[36926fb1-59c5-404a-ad2d-139ac281b55e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542b37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d6aff-1e9b-4865-b1b2-f88cd43d82b7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb6b0d5-9646-4185-a3fc-faf008486fa7]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae07042c-4f72-4e3d-988a-096f75a44119]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ec8f5-05d4-48a4-92e9-e126175bb480]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8be4da-8ba6-41e4-a31b-0842b7f7b929]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6439b199-a8bf-4fae-a850-ed9db89d4a20]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260]
Nov 14 14:36:08 user nova-compute[75292]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84cb9532-5489-4c53-8aeb-691aa02efbc4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb2f3bd-d632-4379-8d2a-67a459e4c5ae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== disconnect_volume: return (324ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJcMHgEX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:08 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1419dd-54fa-429e-a715-6006481c88fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]: iSNS:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]: STATIC:
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:08 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:08 user nova-compute[75292]: No targets found.
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:08 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:08 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce37a982-293d-43f9-a9fb-18a962367b49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8db0804-4916-4044-99bb-b6f2ff14e479]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 (non-flash)
Nov 14 14:36:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542adfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54'): ({'sdg'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Removing single pathed devices sdg {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[719db3f9-e241-4e83-939c-5e44d9f19512]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[44272dd1-9e34-44e4-b1e5-8634ad473768]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Flushing IO for device /dev/sdg {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[094c795c-c36d-4ff4-981f-f38c72ec77fd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d931ed-1ec4-42bd-adbc-1fd01eabc4d3]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] SCSI volumes sdg have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feb039a-7627-47c7-bb25-ef84555612e8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a94603-faed-44dc-b312-2403e75827d9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260]
Nov 14 14:36:09 user nova-compute[75292]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4ac17a3-e1e2-40e3-83c7-3f54a18fbc54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10effa20-d1b1-4fea-ae4c-b1743af7cfeb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] <== disconnect_volume: return (301ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Deleting instance files /opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a_del
Nov 14 14:36:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Deletion of /opt/stack/data/nova/instances/c2c1c552-a700-4429-b258-7d662389822a_del complete
Nov 14 14:36:09 user nova-compute[75292]: INFO nova.compute.manager [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Took 3.83 seconds to destroy the instance on the hypervisor.
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c2c1c552-a700-4429-b258-7d662389822a] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c2c1c552-a700-4429-b258-7d662389822a] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] Acquiring lock "c2c1c552-a700-4429-b258-7d662389822a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] Lock "c2c1c552-a700-4429-b258-7d662389822a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] No waiting events found dispatching network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:09 user nova-compute[75292]: WARNING nova.compute.manager [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received unexpected event network-vif-plugged-8caca002-bd65-462d-a092-04e12e9ba1b5 for instance with vm_state active and task_state deleting.
Nov 14 14:36:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-d19906c7-0e48-477f-98fd-af41f5721136 req-cc041ef9-e686-4f2e-802e-8da17544fcd0 service nova] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Received event network-vif-deleted-5987ebf3-7ab4-4bfe-a617-03d5fb4a5473 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:10 user nova-compute[75292]: INFO nova.compute.manager [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] [instance: b6d0c21e-94fd-4a61-8f05-884727be61d2] Took 2.44 seconds to detach 3 volumes for instance.
Nov 14 14:36:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:10 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:10 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:11 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Deleted allocations for instance b6d0c21e-94fd-4a61-8f05-884727be61d2
Nov 14 14:36:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3cf82010-7f9c-45b0-b23f-d944ad02bff5 tempest-TaggedBootDevicesTest_v242-412349485 tempest-TaggedBootDevicesTest_v242-412349485-project-member] Lock "b6d0c21e-94fd-4a61-8f05-884727be61d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.036s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-deleted-15fbf7b7-f7a5-4703-9848-648aa5f590d3 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:11 user nova-compute[75292]: INFO nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Neutron deleted interface 15fbf7b7-f7a5-4703-9848-648aa5f590d3; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d90409f-283d-4e5d-af84-252cb61a50ad", "address": "fa:16:3e:73:ef:b4", "network": {"id": "402d120b-7d78-46d8-94be-e7d585be2c9e", "bridge": "br-int", "label": "tempest-device-tagging-net2-831001534", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d90409f-28", "ovs_interfaceid": "2d90409f-283d-4e5d-af84-252cb61a50ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Detach interface failed, port_id=15fbf7b7-f7a5-4703-9848-648aa5f590d3, reason: Instance c2c1c552-a700-4429-b258-7d662389822a could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-deleted-2d90409f-283d-4e5d-af84-252cb61a50ad {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:11 user nova-compute[75292]: INFO nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Neutron deleted interface 2d90409f-283d-4e5d-af84-252cb61a50ad; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "address": "fa:16:3e:a6:f5:ac", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab32bf5e-85", "ovs_interfaceid": "ab32bf5e-858b-4989-adbf-1bacc0a61d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Detach interface failed, port_id=2d90409f-283d-4e5d-af84-252cb61a50ad, reason: Instance c2c1c552-a700-4429-b258-7d662389822a could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-deleted-ab32bf5e-858b-4989-adbf-1bacc0a61d82 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:11 user nova-compute[75292]: INFO nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Neutron deleted interface ab32bf5e-858b-4989-adbf-1bacc0a61d82; detaching it from the instance and deleting it from the info cache
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [{"id": "8fd16284-1189-4ea5-a96f-30b7853b8521", "address": "fa:16:3e:23:e2:dd", "network": {"id": "d8bd3ae9-493a-4bc3-9ad1-72e084cf9e0f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1649196407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fd16284-11", "ovs_interfaceid": "8fd16284-1189-4ea5-a96f-30b7853b8521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51bd563-fde7-4660-aded-2a341093c9c1", "address": "fa:16:3e:a6:bd:0b", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51bd563-fd", "ovs_interfaceid": "a51bd563-fde7-4660-aded-2a341093c9c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "address": "fa:16:3e:c7:27:b2", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0265d5b-95", "ovs_interfaceid": "c0265d5b-9575-43b8-9364-cbc3bca906e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8caca002-bd65-462d-a092-04e12e9ba1b5", "address": "fa:16:3e:38:88:f6", "network": {"id": "6af3dbd6-62fe-4fd3-b86e-d19e59b2c813", "bridge": "br-int", "label": "tempest-device-tagging-net1-1354465739", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.43", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b963127017714c239656e80b2af9243f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8caca002-bd", "ovs_interfaceid": "8caca002-bd65-462d-a092-04e12e9ba1b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-86bcfb2b-014b-4dde-91df-ec9bfe2895e9 req-a0ff37a8-834b-4a41-aa54-9cc11bb347e9 service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Detach interface failed, port_id=ab32bf5e-858b-4989-adbf-1bacc0a61d82, reason: Instance c2c1c552-a700-4429-b258-7d662389822a could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:36:12 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d840933b-733f-435d-93cc-d83afd5e2eaa is timed out.
Nov 14 14:36:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Successfully detached device vdb from instance d840933b-733f-435d-93cc-d83afd5e2eaa from the live domain config.
Nov 14 14:36:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SHwofuYm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:12 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f44d04-991a-454f-9408-214fe0791152]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:12 user nova-compute[75292]: No targets found.
Nov 14 14:36:12 user nova-compute[75292]: iSNS:
Nov 14 14:36:12 user nova-compute[75292]: No targets found.
Nov 14 14:36:12 user nova-compute[75292]: STATIC:
Nov 14 14:36:12 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:12 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:12 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:12 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186
Nov 14 14:36:12 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:12 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:12 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:12 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:12 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:12 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:12 user nova-compute[75292]: No targets found.
Nov 14 14:36:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:12 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:12 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[609736c1-7e6a-4ead-8b99-aa2b8c71b2c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66d7c7e-f30e-4126-b6fd-78059a618f19]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:12 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:12 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 (non-flash)
Nov 14 14:36:12 user nova-compute[75292]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:12 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b741467a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186'): ({'sdh'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Removing single pathed devices sdh {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0962a963-c159-49c1-8cc2-d11ec32af786]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0395cf-6848-4e07-b997-7d1a6d29f25d]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Flushing IO for device /dev/sdh {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fa20e7-abca-4607-a584-e86c8471ed87]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d71583-17b3-4dba-b93c-09269717b86a]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] SCSI volumes sdh have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f1beec-8bd5-4b9d-a696-e0b807443275]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c4d793-0416-4c68-91f4-701ac7268be0]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260]
Nov 14 14:36:12 user nova-compute[75292]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c2c1c552-a700-4429-b258-7d662389822a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e72e0f-746f-44ba-af48-7a54ca6b3186 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[defd7e3f-d963-4ecd-a428-4e0a41f4779c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] <== disconnect_volume: return (289ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:12 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c2c1c552-a700-4429-b258-7d662389822a] Took 3.47 seconds to deallocate network for instance.
Nov 14 14:36:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lazy-loading 'flavor' on Instance uuid d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5998b87b-3501-4d13-aef3-24c97b8d1992 tempest-VolumesAssistedSnapshotsTest-1004682999 tempest-VolumesAssistedSnapshotsTest-1004682999-project-admin] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-1c68d2d8-1165-47d8-94bd-5ae4a390c3de req-eea82960-661c-470c-b35a-bc84163e210e service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-deleted-8caca002-bd65-462d-a092-04e12e9ba1b5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-1c68d2d8-1165-47d8-94bd-5ae4a390c3de req-eea82960-661c-470c-b35a-bc84163e210e service nova] [instance: c2c1c552-a700-4429-b258-7d662389822a] Received event network-vif-deleted-8fd16284-1189-4ea5-a96f-30b7853b8521 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:14 user nova-compute[75292]: INFO nova.compute.manager [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] [instance: c2c1c552-a700-4429-b258-7d662389822a] Took 2.09 seconds to detach 3 volumes for instance.
Nov 14 14:36:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:15 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Deleted allocations for instance c2c1c552-a700-4429-b258-7d662389822a
Nov 14 14:36:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18c40db2-e99e-4c5b-ab13-88684d4715bc tempest-TaggedBootDevicesTest-479327237 tempest-TaggedBootDevicesTest-479327237-project-member] Lock "c2c1c552-a700-4429-b258-7d662389822a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.892s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "c1a64402-744c-443f-b6d2-f29e0022b992" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:36:18 user nova-compute[75292]: INFO nova.compute.claims [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Claim successful on node user
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:36:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.policy [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f6816e7810246f39c569b568d2be333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f3598b451430aa15c1f92e1c21aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:36:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Creating image(s)
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "/opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "/opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.164s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk 1073741824" returned: 0 in 0.046s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Successfully created port: 85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Cannot resize image /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Ensure instance console log exists: /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Successfully updated port: 85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "refresh_cache-c1a64402-744c-443f-b6d2-f29e0022b992" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquired lock "refresh_cache-c1a64402-744c-443f-b6d2-f29e0022b992" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received event network-changed-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Refreshing instance network info cache due to event network-changed-85891cca-afc8-4564-9967-aa01032a65f6. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] Acquiring lock "refresh_cache-c1a64402-744c-443f-b6d2-f29e0022b992" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Updating instance_info_cache with network_info: [{"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Releasing lock "refresh_cache-c1a64402-744c-443f-b6d2-f29e0022b992" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Instance network_info: |[{"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] Acquired lock "refresh_cache-c1a64402-744c-443f-b6d2-f29e0022b992" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Refreshing network info cache for port 85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Start _get_guest_xml network_info=[{"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:36:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:36:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-795698347',display_name='tempest-VolumesAdminNegativeTest-server-795698347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-795698347',id=14,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='892f3598b451430aa15c1f92e1c21aaa',ramdisk_id='',reservation_id='r-bpgsn2qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1045564970',owner_user_name='tempest-VolumesAdminNegativeTest-1045564970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:36:19Z,user_data=None,user_id='1f6816e7810246f39c569b568d2be333',uuid=c1a64402-744c-443f-b6d2-f29e0022b992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converting VIF {"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'pci_devices' on Instance uuid c1a64402-744c-443f-b6d2-f29e0022b992 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:36:20 user nova-compute[75292]:   <uuid>c1a64402-744c-443f-b6d2-f29e0022b992</uuid>
Nov 14 14:36:20 user nova-compute[75292]:   <name>instance-0000000e</name>
Nov 14 14:36:20 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:36:20 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:36:20 user nova-compute[75292]:   <metadata>
Nov 14 14:36:20 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:36:20 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:36:20 user nova-compute[75292]:       <nova:name>tempest-VolumesAdminNegativeTest-server-795698347</nova:name>
Nov 14 14:36:20 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:36:20</nova:creationTime>
Nov 14 14:36:20 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:36:20 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:36:20 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:36:20 user nova-compute[75292]:       <nova:owner>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:user uuid="1f6816e7810246f39c569b568d2be333">tempest-VolumesAdminNegativeTest-1045564970-project-member</nova:user>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:project uuid="892f3598b451430aa15c1f92e1c21aaa">tempest-VolumesAdminNegativeTest-1045564970</nova:project>
Nov 14 14:36:20 user nova-compute[75292]:       </nova:owner>
Nov 14 14:36:20 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:36:20 user nova-compute[75292]:       <nova:ports>
Nov 14 14:36:20 user nova-compute[75292]:         <nova:port uuid="85891cca-afc8-4564-9967-aa01032a65f6">
Nov 14 14:36:20 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:36:20 user nova-compute[75292]:         </nova:port>
Nov 14 14:36:20 user nova-compute[75292]:       </nova:ports>
Nov 14 14:36:20 user nova-compute[75292]:     </nova:instance>
Nov 14 14:36:20 user nova-compute[75292]:   </metadata>
Nov 14 14:36:20 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:36:20 user nova-compute[75292]:     <system>
Nov 14 14:36:20 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:36:20 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:36:20 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:36:20 user nova-compute[75292]:       <entry name="serial">c1a64402-744c-443f-b6d2-f29e0022b992</entry>
Nov 14 14:36:20 user nova-compute[75292]:       <entry name="uuid">c1a64402-744c-443f-b6d2-f29e0022b992</entry>
Nov 14 14:36:20 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:36:20 user nova-compute[75292]:     </system>
Nov 14 14:36:20 user nova-compute[75292]:   </sysinfo>
Nov 14 14:36:20 user nova-compute[75292]:   <os>
Nov 14 14:36:20 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:36:20 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:36:20 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:36:20 user nova-compute[75292]:   </os>
Nov 14 14:36:20 user nova-compute[75292]:   <features>
Nov 14 14:36:20 user nova-compute[75292]:     <acpi/>
Nov 14 14:36:20 user nova-compute[75292]:     <apic/>
Nov 14 14:36:20 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:36:20 user nova-compute[75292]:   </features>
Nov 14 14:36:20 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:36:20 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:36:20 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:36:20 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:36:20 user nova-compute[75292]:   </clock>
Nov 14 14:36:20 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:36:20 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:36:20 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:36:20 user nova-compute[75292]:   </cpu>
Nov 14 14:36:20 user nova-compute[75292]:   <devices>
Nov 14 14:36:20 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:36:20 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:36:20 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk"/>
Nov 14 14:36:20 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:36:20 user nova-compute[75292]:     </disk>
Nov 14 14:36:20 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:36:20 user nova-compute[75292]:       <mac address="fa:16:3e:f9:e9:79"/>
Nov 14 14:36:20 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:36:20 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:36:20 user nova-compute[75292]:       <target dev="tap85891cca-af"/>
Nov 14 14:36:20 user nova-compute[75292]:     </interface>
Nov 14 14:36:20 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:36:20 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/console.log" append="off"/>
Nov 14 14:36:20 user nova-compute[75292]:     </serial>
Nov 14 14:36:20 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:36:20 user nova-compute[75292]:     <video>
Nov 14 14:36:20 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:36:20 user nova-compute[75292]:     </video>
Nov 14 14:36:20 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:36:20 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:36:20 user nova-compute[75292]:     </rng>
Nov 14 14:36:20 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:36:20 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:36:20 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:36:20 user nova-compute[75292]:     </memballoon>
Nov 14 14:36:20 user nova-compute[75292]:   </devices>
Nov 14 14:36:20 user nova-compute[75292]: </domain>
Nov 14 14:36:20 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-795698347',display_name='tempest-VolumesAdminNegativeTest-server-795698347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-795698347',id=14,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='892f3598b451430aa15c1f92e1c21aaa',ramdisk_id='',reservation_id='r-bpgsn2qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1045564970',owner_user_name='tempest-VolumesAdminNegativeTest-1045564970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:36:19Z,user_data=None,user_id='1f6816e7810246f39c569b568d2be333',uuid=c1a64402-744c-443f-b6d2-f29e0022b992,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converting VIF {"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG os_vif [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '121bfadc-c6bd-559c-8400-44a0256050a5', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85891cca-af, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85891cca-af, col_values=(('qos', UUID('7bbb93f0-26f6-4d41-b9ba-f35f3be7de8b')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85891cca-af, col_values=(('external_ids', {'iface-id': '85891cca-afc8-4564-9967-aa01032a65f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:e9:79', 'vm-uuid': 'c1a64402-744c-443f-b6d2-f29e0022b992'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:20 user nova-compute[75292]: INFO os_vif [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af')
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] No VIF found with MAC fa:16:3e:f9:e9:79, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Updated VIF entry in instance network info cache for port 85891cca-afc8-4564-9967-aa01032a65f6. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Updating instance_info_cache with network_info: [{"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edcbee28-4ee8-48b4-b4f6-c37582d5472c req-e9fa55fc-98e7-4da2-b847-d980c9dafd13 service nova] Releasing lock "refresh_cache-c1a64402-744c-443f-b6d2-f29e0022b992" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:36:21 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 092131de-273a-4410-bc2e-84f02a3e081f is timed out.
Nov 14 14:36:21 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Successfully detached device vdb from instance 092131de-273a-4410-bc2e-84f02a3e081f from the live domain config.
Nov 14 14:36:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PJQFSAgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'f34b87ca-9ab8-4354-abe2-d115d9d5668a'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:21 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8961afc-13a2-40f0-b6a4-0315bc2d7f28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:21 user nova-compute[75292]: No targets found.
Nov 14 14:36:21 user nova-compute[75292]: iSNS:
Nov 14 14:36:21 user nova-compute[75292]: No targets found.
Nov 14 14:36:21 user nova-compute[75292]: STATIC:
Nov 14 14:36:21 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a
Nov 14 14:36:21 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:21 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:21 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:21 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:21 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:21 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:21 user nova-compute[75292]: No targets found.
Nov 14 14:36:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:21 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:21 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5561823-f890-49f0-87b0-526a33a5b0a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37cdc4-d9b0-46de-a86a-275cc2d10360]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:21 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a (non-flash)
Nov 14 14:36:21 user nova-compute[75292]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542c3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a'): ({'sdi'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Removing single pathed devices sdi {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedb89d0-1cd7-4e74-9f7e-17f53d3264f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[707081ca-cbdc-4977-886e-56304dc52bfa]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Flushing IO for device /dev/sdi {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c254cf1-5af8-45a2-bda2-7ade587ddd5d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc09932d-20d0-45d6-96b2-2565492f966f]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] SCSI volumes sdi have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c88bbf-11a5-46a0-bb9d-d21ed44e24ce]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa2e38-eca0-4840-806a-d31e7f26e1cc]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260]
Nov 14 14:36:21 user nova-compute[75292]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f34b87ca-9ab8-4354-abe2-d115d9d5668a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[71433b3b-6533-40d3-8a57-0a42e9c4a0bf]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] <== disconnect_volume: return (287ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-f1328495-60b2-49f1-a964-6045d3c08271 req-292c6c0e-6e5f-4fbc-b433-de2157331555 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received event network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f1328495-60b2-49f1-a964-6045d3c08271 req-292c6c0e-6e5f-4fbc-b433-de2157331555 service nova] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f1328495-60b2-49f1-a964-6045d3c08271 req-292c6c0e-6e5f-4fbc-b433-de2157331555 service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f1328495-60b2-49f1-a964-6045d3c08271 req-292c6c0e-6e5f-4fbc-b433-de2157331555 service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-f1328495-60b2-49f1-a964-6045d3c08271 req-292c6c0e-6e5f-4fbc-b433-de2157331555 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] No waiting events found dispatching network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:22 user nova-compute[75292]: WARNING nova.compute.manager [req-f1328495-60b2-49f1-a964-6045d3c08271 req-292c6c0e-6e5f-4fbc-b433-de2157331555 service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received unexpected event network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 for instance with vm_state building and task_state spawning.
Nov 14 14:36:22 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lazy-loading 'flavor' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6fe0efb1-0823-4609-b256-3ae0991f3f59 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.315s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Instance spawned successfully.
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:24 user nova-compute[75292]: INFO nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-66b3dc85-026e-4097-9faa-7d33992eec7f req-fdeba8ac-d877-4bb2-a8fa-18ff6629196f service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received event network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66b3dc85-026e-4097-9faa-7d33992eec7f req-fdeba8ac-d877-4bb2-a8fa-18ff6629196f service nova] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66b3dc85-026e-4097-9faa-7d33992eec7f req-fdeba8ac-d877-4bb2-a8fa-18ff6629196f service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-66b3dc85-026e-4097-9faa-7d33992eec7f req-fdeba8ac-d877-4bb2-a8fa-18ff6629196f service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-66b3dc85-026e-4097-9faa-7d33992eec7f req-fdeba8ac-d877-4bb2-a8fa-18ff6629196f service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] No waiting events found dispatching network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:24 user nova-compute[75292]: WARNING nova.compute.manager [req-66b3dc85-026e-4097-9faa-7d33992eec7f req-fdeba8ac-d877-4bb2-a8fa-18ff6629196f service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received unexpected event network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 for instance with vm_state building and task_state spawning.
Nov 14 14:36:24 user nova-compute[75292]: INFO nova.compute.manager [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Took 6.14 seconds to build instance.
Nov 14 14:36:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4ecc04c5-f9d9-4bba-8156-caaa963f25d7 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "c1a64402-744c-443f-b6d2-f29e0022b992" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.237s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:25 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ca01398a-e681-42df-a1cb-0c89ee029386 is timed out.
Nov 14 14:36:25 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Successfully detached device vdb from instance ca01398a-e681-42df-a1cb-0c89ee029386 from the live domain config.
Nov 14 14:36:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXgZPKvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:25 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc53a77-60dd-4316-af1b-04959a8343bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:36:25 user nova-compute[75292]: No targets found.
Nov 14 14:36:25 user nova-compute[75292]: iSNS:
Nov 14 14:36:25 user nova-compute[75292]: No targets found.
Nov 14 14:36:25 user nova-compute[75292]: STATIC:
Nov 14 14:36:25 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525
Nov 14 14:36:25 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:36:25 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:36:25 user nova-compute[75292]: FIRMWARE:
Nov 14 14:36:25 user nova-compute[75292]: No targets found.
Nov 14 14:36:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:36:25 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:36:25 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a4304-b9af-4c63-8489-ca09213e0582]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d9367-0cbc-4352-b0bb-85b86b11830e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 (non-flash)
Nov 14 14:36:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542b27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525'): ({'sdj'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Removing single pathed devices sdj {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e5b0d3-6715-4b78-b1c2-b9c2fa02e0ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c4179-c4d9-4296-ba8f-3267771ce99a]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Flushing IO for device /dev/sdj {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca9b54-e667-4280-8d9e-3d7cc3ef9f73]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb24b46-ce04-4823-a457-81c2652735f8]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] SCSI volumes sdj have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[21416f92-2d6a-4a21-8558-dc1a96f2f210]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6253bc-8aee-4d36-b294-d29e7e06d7b6]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260]
Nov 14 14:36:25 user nova-compute[75292]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525, portal: 172.16.0.220,3260] successful.
Nov 14 14:36:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64301974-0561-4015-9781-42c690bd7525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca95fb-f8fe-4802-a2de-09c02febc725]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] <== disconnect_volume: return (318ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:36:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:26 user nova-compute[75292]: DEBUG nova.objects.instance [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lazy-loading 'flavor' on Instance uuid ca01398a-e681-42df-a1cb-0c89ee029386 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3a6df3fc-286a-4514-a94d-a87d484db7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:44 user nova-compute[75292]: INFO nova.compute.manager [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Terminating instance
Nov 14 14:36:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-a5984b27-3002-47b4-8e60-79237e476c94 req-1e593226-39f6-40d7-bca7-3ebb5dd66f02 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-vif-unplugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a5984b27-3002-47b4-8e60-79237e476c94 req-1e593226-39f6-40d7-bca7-3ebb5dd66f02 service nova] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a5984b27-3002-47b4-8e60-79237e476c94 req-1e593226-39f6-40d7-bca7-3ebb5dd66f02 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a5984b27-3002-47b4-8e60-79237e476c94 req-1e593226-39f6-40d7-bca7-3ebb5dd66f02 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-a5984b27-3002-47b4-8e60-79237e476c94 req-1e593226-39f6-40d7-bca7-3ebb5dd66f02 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] No waiting events found dispatching network-vif-unplugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-a5984b27-3002-47b4-8e60-79237e476c94 req-1e593226-39f6-40d7-bca7-3ebb5dd66f02 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-vif-unplugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Instance destroyed successfully.
Nov 14 14:36:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lazy-loading 'resources' on Instance uuid d840933b-733f-435d-93cc-d83afd5e2eaa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-811718922',display_name='tempest-VolumesAssistedSnapshotsTest-server-811718922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-811718922',id=8,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPQFb4y0STltrofecsFNboiEiBFT7OtqCTmZp2lhQ82QVhSq8B7T3zCjqCMpfBTv817arS4whEz+LzQpxBJBkcxpjHKpYm8fs92wU7fThZVOmUjjp9MV6mzUunqKrjhkg==',key_name='tempest-keypair-993343820',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d64b2adb8bc44cc4ab90960aff1eeb7b',ramdisk_id='',reservation_id='r-zl8ahy0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1243454398',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1243454398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e012eb20d3a747839438c163a6ef5318',uuid=d840933b-733f-435d-93cc-d83afd5e2eaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Converting VIF {"id": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "address": "fa:16:3e:2c:47:a9", "network": {"id": "efd304ad-98a6-430f-a95e-28cbd6e384a5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1602158189-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d64b2adb8bc44cc4ab90960aff1eeb7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c3fced5-ac", "ovs_interfaceid": "1c3fced5-ac28-4e27-9f2f-86082ab39b03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG os_vif [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c3fced5-ac, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8b7de22-b270-4fb2-893e-397cf612710d) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:45 user nova-compute[75292]: INFO os_vif [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:47:a9,bridge_name='br-int',has_traffic_filtering=True,id=1c3fced5-ac28-4e27-9f2f-86082ab39b03,network=Network(efd304ad-98a6-430f-a95e-28cbd6e384a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c3fced5-ac')
Nov 14 14:36:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Deleting instance files /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa_del
Nov 14 14:36:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Deletion of /opt/stack/data/nova/instances/d840933b-733f-435d-93cc-d83afd5e2eaa_del complete
Nov 14 14:36:45 user nova-compute[75292]: INFO nova.compute.manager [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 14:36:45 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:36:45 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:46 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Took 0.90 seconds to deallocate network for instance.
Nov 14 14:36:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-92b0f124-9a77-4dbd-9bab-05cbc6c74ead req-4622202f-2fb5-4879-a644-e0e7bde7a209 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-vif-deleted-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:46 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Deleted allocations for instance d840933b-733f-435d-93cc-d83afd5e2eaa
Nov 14 14:36:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-0a97bc19-4914-4820-8204-e06972127bbb req-c56cd53c-b752-4846-a879-0e1a2ffe29c6 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received event network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0a97bc19-4914-4820-8204-e06972127bbb req-c56cd53c-b752-4846-a879-0e1a2ffe29c6 service nova] Acquiring lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0a97bc19-4914-4820-8204-e06972127bbb req-c56cd53c-b752-4846-a879-0e1a2ffe29c6 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0a97bc19-4914-4820-8204-e06972127bbb req-c56cd53c-b752-4846-a879-0e1a2ffe29c6 service nova] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-0a97bc19-4914-4820-8204-e06972127bbb req-c56cd53c-b752-4846-a879-0e1a2ffe29c6 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] No waiting events found dispatching network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:46 user nova-compute[75292]: WARNING nova.compute.manager [req-0a97bc19-4914-4820-8204-e06972127bbb req-c56cd53c-b752-4846-a879-0e1a2ffe29c6 service nova] [instance: d840933b-733f-435d-93cc-d83afd5e2eaa] Received unexpected event network-vif-plugged-1c3fced5-ac28-4e27-9f2f-86082ab39b03 for instance with vm_state deleted and task_state None.
Nov 14 14:36:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-003653c9-6002-45e8-b519-7b9b6e130860 tempest-VolumesAssistedSnapshotsTest-1243454398 tempest-VolumesAssistedSnapshotsTest-1243454398-project-member] Lock "d840933b-733f-435d-93cc-d83afd5e2eaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:50 user nova-compute[75292]: INFO nova.compute.manager [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Terminating instance
Nov 14 14:36:50 user nova-compute[75292]: DEBUG nova.compute.manager [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-badb0f4d-e60b-4ccb-bc08-b77921a50a56 req-0c8b24f4-8b19-4fd1-aac3-875413493dc4 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-vif-unplugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-badb0f4d-e60b-4ccb-bc08-b77921a50a56 req-0c8b24f4-8b19-4fd1-aac3-875413493dc4 service nova] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-badb0f4d-e60b-4ccb-bc08-b77921a50a56 req-0c8b24f4-8b19-4fd1-aac3-875413493dc4 service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-badb0f4d-e60b-4ccb-bc08-b77921a50a56 req-0c8b24f4-8b19-4fd1-aac3-875413493dc4 service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-badb0f4d-e60b-4ccb-bc08-b77921a50a56 req-0c8b24f4-8b19-4fd1-aac3-875413493dc4 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] No waiting events found dispatching network-vif-unplugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-badb0f4d-e60b-4ccb-bc08-b77921a50a56 req-0c8b24f4-8b19-4fd1-aac3-875413493dc4 service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-vif-unplugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Instance destroyed successfully.
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lazy-loading 'resources' on Instance uuid 092131de-273a-4410-bc2e-84f02a3e081f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2060622894',display_name='tempest-TestVolumeSwap-server-2060622894',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2060622894',id=7,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCFrTWF15toPmexPh17cmowT8Ewg/Tnv6QHOiG6wF7cBwb5gLdmVzqXYz293O8lpgxeUPhHUJc2tscz7l87mGGXwdnOkLrdZBwG+mplSaw33hTRpC3qmhf9tpXrmVzrdg==',key_name='tempest-keypair-2037972140',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a53f2f79e03f48f684cfa39c515c154d',ramdisk_id='',reservation_id='r-z06kebhq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-792431185',owner_user_name='tempest-TestVolumeSwap-792431185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6050224dba22476d9acf79d57adbab7f',uuid=092131de-273a-4410-bc2e-84f02a3e081f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Converting VIF {"id": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "address": "fa:16:3e:6c:0b:33", "network": {"id": "e80f0868-6b77-401d-8982-78765f248475", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1056240245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a53f2f79e03f48f684cfa39c515c154d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbb45e39-31", "ovs_interfaceid": "cbb45e39-31ab-4b6d-a3d8-2fd7337c6099", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG os_vif [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbb45e39-31, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82ff3fda-0dba-4b67-afe8-67efd43c3e73) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:51 user nova-compute[75292]: INFO os_vif [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:0b:33,bridge_name='br-int',has_traffic_filtering=True,id=cbb45e39-31ab-4b6d-a3d8-2fd7337c6099,network=Network(e80f0868-6b77-401d-8982-78765f248475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbb45e39-31')
Nov 14 14:36:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Deleting instance files /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f_del
Nov 14 14:36:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Deletion of /opt/stack/data/nova/instances/092131de-273a-4410-bc2e-84f02a3e081f_del complete
Nov 14 14:36:51 user nova-compute[75292]: INFO nova.compute.manager [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 14:36:51 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:36:51 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:36:52 user nova-compute[75292]: INFO nova.compute.claims [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Claim successful on node user
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:52 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Took 0.87 seconds to deallocate network for instance.
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.323s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:36:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:36:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.policy [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eaeef475e0554905982ae3762b4e1be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a8c84debb904cc5b4798f3abc42c05e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:36:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Creating image(s)
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "/opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "/opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "/opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] Acquiring lock "092131de-273a-4410-bc2e-84f02a3e081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] Lock "092131de-273a-4410-bc2e-84f02a3e081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] No waiting events found dispatching network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:53 user nova-compute[75292]: WARNING nova.compute.manager [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received unexpected event network-vif-plugged-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 for instance with vm_state deleted and task_state None.
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-b12094ee-e1ef-4f72-8598-dff0cd7864a8 req-cdfb3fa2-f22e-408d-9888-e4f0ad50e72a service nova] [instance: 092131de-273a-4410-bc2e-84f02a3e081f] Received event network-vif-deleted-cbb45e39-31ab-4b6d-a3d8-2fd7337c6099 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:53 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Deleted allocations for instance 092131de-273a-4410-bc2e-84f02a3e081f
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.193s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk 1073741824" returned: 0 in 0.051s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-de3a07fb-122d-475d-a4b3-699a26972125 tempest-TestVolumeSwap-792431185 tempest-TestVolumeSwap-792431185-project-member] Lock "092131de-273a-4410-bc2e-84f02a3e081f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.933s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Cannot resize image /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Ensure instance console log exists: /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Successfully created port: d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Successfully updated port: d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "refresh_cache-81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquired lock "refresh_cache-81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:36:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Updating instance_info_cache with network_info: [{"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Releasing lock "refresh_cache-81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Instance network_info: |[{"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Start _get_guest_xml network_info=[{"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:36:55 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:36:55 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-42417043',display_name='tempest-VolumesActionsTest-instance-42417043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-42417043',id=15,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a8c84debb904cc5b4798f3abc42c05e',ramdisk_id='',reservation_id='r-j0c5vme0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1975132646',owner_user_name='tempest-VolumesActionsTest-1975132646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:36:53Z,user_data=None,user_id='eaeef475e0554905982ae3762b4e1be6',uuid=81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converting VIF {"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lazy-loading 'pci_devices' on Instance uuid 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:36:55 user nova-compute[75292]:   <uuid>81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b</uuid>
Nov 14 14:36:55 user nova-compute[75292]:   <name>instance-0000000f</name>
Nov 14 14:36:55 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:36:55 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:36:55 user nova-compute[75292]:   <metadata>
Nov 14 14:36:55 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:36:55 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:36:55 user nova-compute[75292]:       <nova:name>tempest-VolumesActionsTest-instance-42417043</nova:name>
Nov 14 14:36:55 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:36:55</nova:creationTime>
Nov 14 14:36:55 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:36:55 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:36:55 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:36:55 user nova-compute[75292]:       <nova:owner>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:user uuid="eaeef475e0554905982ae3762b4e1be6">tempest-VolumesActionsTest-1975132646-project-member</nova:user>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:project uuid="1a8c84debb904cc5b4798f3abc42c05e">tempest-VolumesActionsTest-1975132646</nova:project>
Nov 14 14:36:55 user nova-compute[75292]:       </nova:owner>
Nov 14 14:36:55 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:36:55 user nova-compute[75292]:       <nova:ports>
Nov 14 14:36:55 user nova-compute[75292]:         <nova:port uuid="d6a44490-3bb5-4984-aec2-df9c44c0154c">
Nov 14 14:36:55 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:36:55 user nova-compute[75292]:         </nova:port>
Nov 14 14:36:55 user nova-compute[75292]:       </nova:ports>
Nov 14 14:36:55 user nova-compute[75292]:     </nova:instance>
Nov 14 14:36:55 user nova-compute[75292]:   </metadata>
Nov 14 14:36:55 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:36:55 user nova-compute[75292]:     <system>
Nov 14 14:36:55 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:36:55 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:36:55 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:36:55 user nova-compute[75292]:       <entry name="serial">81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b</entry>
Nov 14 14:36:55 user nova-compute[75292]:       <entry name="uuid">81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b</entry>
Nov 14 14:36:55 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:36:55 user nova-compute[75292]:     </system>
Nov 14 14:36:55 user nova-compute[75292]:   </sysinfo>
Nov 14 14:36:55 user nova-compute[75292]:   <os>
Nov 14 14:36:55 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:36:55 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:36:55 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:36:55 user nova-compute[75292]:   </os>
Nov 14 14:36:55 user nova-compute[75292]:   <features>
Nov 14 14:36:55 user nova-compute[75292]:     <acpi/>
Nov 14 14:36:55 user nova-compute[75292]:     <apic/>
Nov 14 14:36:55 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:36:55 user nova-compute[75292]:   </features>
Nov 14 14:36:55 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:36:55 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:36:55 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:36:55 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:36:55 user nova-compute[75292]:   </clock>
Nov 14 14:36:55 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:36:55 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:36:55 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:36:55 user nova-compute[75292]:   </cpu>
Nov 14 14:36:55 user nova-compute[75292]:   <devices>
Nov 14 14:36:55 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:36:55 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:36:55 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk"/>
Nov 14 14:36:55 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:36:55 user nova-compute[75292]:     </disk>
Nov 14 14:36:55 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:36:55 user nova-compute[75292]:       <mac address="fa:16:3e:b4:c5:30"/>
Nov 14 14:36:55 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:36:55 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:36:55 user nova-compute[75292]:       <target dev="tapd6a44490-3b"/>
Nov 14 14:36:55 user nova-compute[75292]:     </interface>
Nov 14 14:36:55 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:36:55 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/console.log" append="off"/>
Nov 14 14:36:55 user nova-compute[75292]:     </serial>
Nov 14 14:36:55 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:36:55 user nova-compute[75292]:     <video>
Nov 14 14:36:55 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:36:55 user nova-compute[75292]:     </video>
Nov 14 14:36:55 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:36:55 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:36:55 user nova-compute[75292]:     </rng>
Nov 14 14:36:55 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:36:55 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:36:55 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:36:55 user nova-compute[75292]:     </memballoon>
Nov 14 14:36:55 user nova-compute[75292]:   </devices>
Nov 14 14:36:55 user nova-compute[75292]: </domain>
Nov 14 14:36:55 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-42417043',display_name='tempest-VolumesActionsTest-instance-42417043',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-42417043',id=15,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a8c84debb904cc5b4798f3abc42c05e',ramdisk_id='',reservation_id='r-j0c5vme0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1975132646',owner_user_name='tempest-VolumesActionsTest-1975132646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:36:53Z,user_data=None,user_id='eaeef475e0554905982ae3762b4e1be6',uuid=81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converting VIF {"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG os_vif [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf464d7c-b1bd-57f5-9c3e-6cea39b268a5', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6a44490-3b, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6a44490-3b, col_values=(('qos', UUID('a6c23996-463f-4c6a-88cb-57ec5655069e')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6a44490-3b, col_values=(('external_ids', {'iface-id': 'd6a44490-3bb5-4984-aec2-df9c44c0154c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:c5:30', 'vm-uuid': '81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:55 user nova-compute[75292]: INFO os_vif [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b')
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-changed-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Refreshing instance network info cache due to event network-changed-d6a44490-3bb5-4984-aec2-df9c44c0154c. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] Acquiring lock "refresh_cache-81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] Acquired lock "refresh_cache-81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Refreshing network info cache for port d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] No VIF found with MAC fa:16:3e:b4:c5:30, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Updated VIF entry in instance network info cache for port d6a44490-3bb5-4984-aec2-df9c44c0154c. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Updating instance_info_cache with network_info: [{"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:36:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d72f701-9bf9-4ddf-b4d2-252301338dbb req-0a513f15-cd7e-4ecd-a53b-2057becb6b81 service nova] Releasing lock "refresh_cache-81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG nova.objects.instance [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'flavor' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:56 user nova-compute[75292]: INFO nova.compute.manager [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Attaching volume 4512e466-37fd-4d88-9657-b502c397bd35 to /dev/vdb
Nov 14 14:36:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcef102-fccb-4ab3-9124-01b1ec65fe4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c98be74-fcdd-48a5-8143-463ee97cb65e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc0c12-2b49-4fb1-9769-3a81f155eca6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdc3be4-bdb1-4ff2-ba35-a75c2dd382e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:36:56 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:36:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7078d39-724e-4214-aa96-4044694dfc84]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:36:56 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating existing volume attachment record: 65c33fcf-5c8c-453b-8459-f50cbf23c5c9 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-1b29a014-f173-4329-b890-864b647de0f1 req-305ca77a-49a1-4ee1-adcb-7cbdde85a07e service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1b29a014-f173-4329-b890-864b647de0f1 req-305ca77a-49a1-4ee1-adcb-7cbdde85a07e service nova] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1b29a014-f173-4329-b890-864b647de0f1 req-305ca77a-49a1-4ee1-adcb-7cbdde85a07e service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1b29a014-f173-4329-b890-864b647de0f1 req-305ca77a-49a1-4ee1-adcb-7cbdde85a07e service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-1b29a014-f173-4329-b890-864b647de0f1 req-305ca77a-49a1-4ee1-adcb-7cbdde85a07e service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] No waiting events found dispatching network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:57 user nova-compute[75292]: WARNING nova.compute.manager [req-1b29a014-f173-4329-b890-864b647de0f1 req-305ca77a-49a1-4ee1-adcb-7cbdde85a07e service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received unexpected event network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c for instance with vm_state building and task_state spawning.
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:57 user nova-compute[75292]: INFO nova.compute.manager [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Terminating instance
Nov 14 14:36:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Instance destroyed successfully.
Nov 14 14:36:58 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lazy-loading 'resources' on Instance uuid ca01398a-e681-42df-a1cb-0c89ee029386 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-334482785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3344827',id=10,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDd8CRN0EcdS2nidF9a5wUlDfAvLSnsvCzJjCaMftTwobleIWiLdIbz6yak4Twxv5s02k17eJEQjrppyHkTU5dxZXzqiRnlNAOXAeSez/OsjAoGE6exndbhtL8bzYUcJeA==',key_name='tempest-keypair-1566938889',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:34:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='818b2e390bd14d64ae31a85c51408aca',ramdisk_id='',reservation_id='r-mrne92ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1049711670',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb6f3499107a45788834ea9fc745fe3c',uuid=ca01398a-e681-42df-a1cb-0c89ee029386,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Converting VIF {"id": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "address": "fa:16:3e:25:73:52", "network": {"id": "ae3cd290-448b-4d1d-9c34-510bc4a17015", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1570150426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "818b2e390bd14d64ae31a85c51408aca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f4bea9a-41", "ovs_interfaceid": "3f4bea9a-41aa-42a2-b1ab-a71852e3e972", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG os_vif [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f4bea9a-41, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f369f38-6529-4f15-bd0e-dccb32f52d49) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: INFO os_vif [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:73:52,bridge_name='br-int',has_traffic_filtering=True,id=3f4bea9a-41aa-42a2-b1ab-a71852e3e972,network=Network(ae3cd290-448b-4d1d-9c34-510bc4a17015),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f4bea9a-41')
Nov 14 14:36:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Deleting instance files /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386_del
Nov 14 14:36:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Deletion of /opt/stack/data/nova/instances/ca01398a-e681-42df-a1cb-0c89ee029386_del complete
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: INFO nova.compute.manager [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 14 14:36:58 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] No waiting events found dispatching network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:59 user nova-compute[75292]: WARNING nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received unexpected event network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c for instance with vm_state building and task_state spawning.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-unplugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-unplugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-unplugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:59 user nova-compute[75292]: WARNING nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received unexpected event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with vm_state active and task_state deleting.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:59 user nova-compute[75292]: WARNING nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received unexpected event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with vm_state active and task_state deleting.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:59 user nova-compute[75292]: WARNING nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received unexpected event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with vm_state active and task_state deleting.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-unplugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-unplugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd7081d4-376f-45ee-968c-3a40eae2619b req-ff83ddcb-bfcc-4b9d-ae8d-4cada54f35c2 service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-unplugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:36:59 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Instance spawned successfully.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:36:59 user nova-compute[75292]: INFO nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:36:59 user nova-compute[75292]: INFO nova.compute.manager [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Took 7.13 seconds to build instance.
Nov 14 14:36:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9eb0a2f7-2086-4ea4-82c0-07d7b15a5bee tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.248s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:00 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:00 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Took 2.30 seconds to deallocate network for instance.
Nov 14 14:37:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-cc03c44a-89a1-4512-b2bb-377d4f645dac req-bba72af6-1a01-470c-935f-f813352e24be service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-deleted-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:37:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:37:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:00 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Deleted allocations for instance ca01398a-e681-42df-a1cb-0c89ee029386
Nov 14 14:37:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0c575525-183b-4e73-9b7d-7fb5b8ea01ff tempest-TestServerVolumeAttachScenarioOldVersion-1049711670 tempest-TestServerVolumeAttachScenarioOldVersion-1049711670-project-member] Lock "ca01398a-e681-42df-a1cb-0c89ee029386" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.868s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb8fdf48-c955-4b2b-a58e-1f5fafb2c73a req-eec279b8-d3a1-4dd3-a611-18e68da9174b service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb8fdf48-c955-4b2b-a58e-1f5fafb2c73a req-eec279b8-d3a1-4dd3-a611-18e68da9174b service nova] Acquiring lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb8fdf48-c955-4b2b-a58e-1f5fafb2c73a req-eec279b8-d3a1-4dd3-a611-18e68da9174b service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb8fdf48-c955-4b2b-a58e-1f5fafb2c73a req-eec279b8-d3a1-4dd3-a611-18e68da9174b service nova] Lock "ca01398a-e681-42df-a1cb-0c89ee029386-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb8fdf48-c955-4b2b-a58e-1f5fafb2c73a req-eec279b8-d3a1-4dd3-a611-18e68da9174b service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] No waiting events found dispatching network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:01 user nova-compute[75292]: WARNING nova.compute.manager [req-fb8fdf48-c955-4b2b-a58e-1f5fafb2c73a req-eec279b8-d3a1-4dd3-a611-18e68da9174b service nova] [instance: ca01398a-e681-42df-a1cb-0c89ee029386] Received unexpected event network-vif-plugged-3f4bea9a-41aa-42a2-b1ab-a71852e3e972 for instance with vm_state deleted and task_state None.
Nov 14 14:37:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:37:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:37:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:37:02 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a97fe-2f92-43a3-8395-5dd0b3eca193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:37:02 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5102f08-ab4b-482a-9414-cebcc2106b0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35] added
Nov 14 14:37:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e018e-6b0f-4701-9aef-9f1eff45f9ec]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c02b0-542a-4098-8b9e-5de1915721b5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSuPnEzO {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSuPnEzO" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4b374-eaba-4e37-b5eb-70a762aef74d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSuPnEzO'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0ca08-27b4-4990-abae-b4530c81bc6e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882ae9a-2bd3-4361-ad26-af9da0f7f5b5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:37:02 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:37:02 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:37:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 14:37:02 user nova-compute[75292]: 
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ca096-77cb-4c85-b51c-82ac57ae3de4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]
Nov 14 14:37:02 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.
Nov 14 14:37:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:37:02 user nova-compute[75292]: INFO nova.compute.claims [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Claim successful on node user
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a92af-910c-45d0-bfc6-b79ce3f8e1a4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea114e-10ca-425d-8545-f7bd2c81727f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:37:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:37:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60109c8c-b076-4a4f-94f0-6d13f6c16014]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:37:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.policy [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e75042706a2347ebba11d20ba65ba282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b7e88c2e88460484f06a772b1f60c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:37:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Creating image(s)
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.226s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26434323532303937', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434323532303937', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.objects.instance [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'flavor' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:37:03 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:37:03 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:37:03 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:37:03 user nova-compute[75292]:   <serial>4512e466-37fd-4d88-9657-b502c397bd35</serial>
Nov 14 14:37:03 user nova-compute[75292]: </disk>
Nov 14 14:37:03 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk 1073741824" returned: 0 in 0.057s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.193s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:37:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No VIF found with MAC fa:16:3e:73:d7:5d, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Cannot resize image /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Ensure instance console log exists: /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc8f6710-ac82-4d7f-b1f6-b688408c4576 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.865s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Successfully created port: c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:37:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Successfully updated port: c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquired lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-changed-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Refreshing instance network info cache due to event network-changed-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] Acquiring lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating instance_info_cache with network_info: [{"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Releasing lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance network_info: |[{"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] Acquired lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Refreshing network info cache for port c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Start _get_guest_xml network_info=[{"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Stashing vm_state: active {{(pid=75292) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:08 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:08 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-935294165',display_name='tempest-tempest.common.compute-instance-935294165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-935294165',id=16,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4PSWGM/1ftzwfDAUuYKxU/kl/E9ddsjcDHS5qvs1EZt9ShsPr19Pfa5LyW4urTLQ7G5FMF4MozVRL9Ox3bsqMTLxcdONv1cFJ8IQVNm7DDDavOofdZzJVSCkLE5kGTiQ==',key_name='tempest-keypair-1422090515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-rfdcmkpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=e153ead2-1bf6-410b-9b0a-3c1bef1f8062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'pci_devices' on Instance uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:37:08 user nova-compute[75292]:   <uuid>e153ead2-1bf6-410b-9b0a-3c1bef1f8062</uuid>
Nov 14 14:37:08 user nova-compute[75292]:   <name>instance-00000010</name>
Nov 14 14:37:08 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:37:08 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:37:08 user nova-compute[75292]:   <metadata>
Nov 14 14:37:08 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:37:08 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:37:08 user nova-compute[75292]:       <nova:name>tempest-tempest.common.compute-instance-935294165</nova:name>
Nov 14 14:37:08 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:37:08</nova:creationTime>
Nov 14 14:37:08 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:37:08 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:37:08 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:37:08 user nova-compute[75292]:       <nova:owner>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:user uuid="e75042706a2347ebba11d20ba65ba282">tempest-ServerActionsTestOtherA-1545988335-project-member</nova:user>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:project uuid="54b7e88c2e88460484f06a772b1f60c3">tempest-ServerActionsTestOtherA-1545988335</nova:project>
Nov 14 14:37:08 user nova-compute[75292]:       </nova:owner>
Nov 14 14:37:08 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:37:08 user nova-compute[75292]:       <nova:ports>
Nov 14 14:37:08 user nova-compute[75292]:         <nova:port uuid="c3d85393-dc7a-40ef-84a8-0e7b69e8aaae">
Nov 14 14:37:08 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:37:08 user nova-compute[75292]:         </nova:port>
Nov 14 14:37:08 user nova-compute[75292]:       </nova:ports>
Nov 14 14:37:08 user nova-compute[75292]:     </nova:instance>
Nov 14 14:37:08 user nova-compute[75292]:   </metadata>
Nov 14 14:37:08 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:37:08 user nova-compute[75292]:     <system>
Nov 14 14:37:08 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:37:08 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:37:08 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:37:08 user nova-compute[75292]:       <entry name="serial">e153ead2-1bf6-410b-9b0a-3c1bef1f8062</entry>
Nov 14 14:37:08 user nova-compute[75292]:       <entry name="uuid">e153ead2-1bf6-410b-9b0a-3c1bef1f8062</entry>
Nov 14 14:37:08 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:37:08 user nova-compute[75292]:     </system>
Nov 14 14:37:08 user nova-compute[75292]:   </sysinfo>
Nov 14 14:37:08 user nova-compute[75292]:   <os>
Nov 14 14:37:08 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:37:08 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:37:08 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:37:08 user nova-compute[75292]:   </os>
Nov 14 14:37:08 user nova-compute[75292]:   <features>
Nov 14 14:37:08 user nova-compute[75292]:     <acpi/>
Nov 14 14:37:08 user nova-compute[75292]:     <apic/>
Nov 14 14:37:08 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:37:08 user nova-compute[75292]:   </features>
Nov 14 14:37:08 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:37:08 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:37:08 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:37:08 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:37:08 user nova-compute[75292]:   </clock>
Nov 14 14:37:08 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:37:08 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:37:08 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:37:08 user nova-compute[75292]:   </cpu>
Nov 14 14:37:08 user nova-compute[75292]:   <devices>
Nov 14 14:37:08 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:37:08 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:37:08 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk"/>
Nov 14 14:37:08 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:37:08 user nova-compute[75292]:     </disk>
Nov 14 14:37:08 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:37:08 user nova-compute[75292]:       <mac address="fa:16:3e:cd:43:9e"/>
Nov 14 14:37:08 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:08 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:37:08 user nova-compute[75292]:       <target dev="tapc3d85393-dc"/>
Nov 14 14:37:08 user nova-compute[75292]:     </interface>
Nov 14 14:37:08 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:37:08 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/console.log" append="off"/>
Nov 14 14:37:08 user nova-compute[75292]:     </serial>
Nov 14 14:37:08 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:37:08 user nova-compute[75292]:     <video>
Nov 14 14:37:08 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:08 user nova-compute[75292]:     </video>
Nov 14 14:37:08 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:37:08 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:37:08 user nova-compute[75292]:     </rng>
Nov 14 14:37:08 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:37:08 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:37:08 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:37:08 user nova-compute[75292]:     </memballoon>
Nov 14 14:37:08 user nova-compute[75292]:   </devices>
Nov 14 14:37:08 user nova-compute[75292]: </domain>
Nov 14 14:37:08 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-935294165',display_name='tempest-tempest.common.compute-instance-935294165',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-935294165',id=16,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4PSWGM/1ftzwfDAUuYKxU/kl/E9ddsjcDHS5qvs1EZt9ShsPr19Pfa5LyW4urTLQ7G5FMF4MozVRL9Ox3bsqMTLxcdONv1cFJ8IQVNm7DDDavOofdZzJVSCkLE5kGTiQ==',key_name='tempest-keypair-1422090515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-rfdcmkpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=e153ead2-1bf6-410b-9b0a-3c1bef1f8062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG os_vif [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362f4694-2f3a-508b-9979-9c99f6ac0e91', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d85393-dc, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d85393-dc, col_values=(('qos', UUID('8199b7c9-1a2b-4017-a73f-e997182c4a9d')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d85393-dc, col_values=(('external_ids', {'iface-id': 'c3d85393-dc7a-40ef-84a8-0e7b69e8aaae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:43:9e', 'vm-uuid': 'e153ead2-1bf6-410b-9b0a-3c1bef1f8062'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:08 user nova-compute[75292]: INFO os_vif [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc')
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:37:08 user nova-compute[75292]: INFO nova.compute.claims [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Claim successful on node user
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No VIF found with MAC fa:16:3e:cd:43:9e, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:37:08 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating resource usage from migration bec59af2-1bb3-48e7-8795-428797abbc85
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.686s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:08 user nova-compute[75292]: INFO nova.compute.manager [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Migrating
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:08 user nova-compute[75292]: INFO nova.compute.rpcapi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 14:37:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updated VIF entry in instance network info cache for port c3d85393-dc7a-40ef-84a8-0e7b69e8aaae. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating instance_info_cache with network_info: [{"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f4eccd0-5efc-4bc4-ae7d-aa7dc56e71b4 req-6956494e-5f0e-4af2-a1d1-58b6982795ff service nova] Releasing lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-ce988ebb-5d0b-4591-ab23-9dd1864fcd04 req-2bf4c42a-a1ad-436b-8f17-f2a1286f35e3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ce988ebb-5d0b-4591-ab23-9dd1864fcd04 req-2bf4c42a-a1ad-436b-8f17-f2a1286f35e3 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ce988ebb-5d0b-4591-ab23-9dd1864fcd04 req-2bf4c42a-a1ad-436b-8f17-f2a1286f35e3 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ce988ebb-5d0b-4591-ab23-9dd1864fcd04 req-2bf4c42a-a1ad-436b-8f17-f2a1286f35e3 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-ce988ebb-5d0b-4591-ab23-9dd1864fcd04 req-2bf4c42a-a1ad-436b-8f17-f2a1286f35e3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:12 user nova-compute[75292]: WARNING nova.compute.manager [req-ce988ebb-5d0b-4591-ab23-9dd1864fcd04 req-2bf4c42a-a1ad-436b-8f17-f2a1286f35e3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state building and task_state spawning.
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance spawned successfully.
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:37:12 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:12 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7822MB free_disk=25.654613494873047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:12 user nova-compute[75292]: INFO nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Took 9.06 seconds to spawn the instance on the hypervisor.
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Applying migration context for instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 as it has an incoming, in-progress migration bec59af2-1bb3-48e7-8795-428797abbc85. Migration status is migrating {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 14:37:12 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating resource usage from migration bec59af2-1bb3-48e7-8795-428797abbc85
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Starting migrate_disk_and_power_off {{(pid=75292) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 44726e61-672d-42a1-81ae-489cb41dc49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c1a64402-744c-443f-b6d2-f29e0022b992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Migration bec59af2-1bb3-48e7-8795-428797abbc85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:37:12 user nova-compute[75292]: INFO nova.compute.manager [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Took 10.05 seconds to build instance.
Nov 14 14:37:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cfd86845-0fa5-4b95-9480-1623754fc97c tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.174s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.680s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:37:13 user nova-compute[75292]: INFO nova.compute.claims [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Claim successful on node user
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance destroyed successfully.
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap681ed373-e7, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d922543d-5d55-43d3-af13-6bc36e965d7f) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:13 user nova-compute[75292]: INFO os_vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7')
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:37:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b64b90a-c603-4085-a365-e4db97eab1fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:37:13 user nova-compute[75292]: No targets found.
Nov 14 14:37:13 user nova-compute[75292]: iSNS:
Nov 14 14:37:13 user nova-compute[75292]: No targets found.
Nov 14 14:37:13 user nova-compute[75292]: STATIC:
Nov 14 14:37:13 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:37:13 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:37:13 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:37:13 user nova-compute[75292]: FIRMWARE:
Nov 14 14:37:13 user nova-compute[75292]: No targets found.
Nov 14 14:37:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:37:13 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:37:13 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6411af-954a-4d0b-b529-a87c3878b18f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f683ad5-1ea6-4b93-adb3-aa8c13505113]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:37:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:37:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5412fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c58577-17f5-46a1-8877-f196d0ba533b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ca533-f096-497c-bf1f-1fcb275936f4]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b420b3f-5e02-422e-b7f0-d3aa36afc4bc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[02118e38-8b7f-4abc-80fc-519b7b3c4d34]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec96c5-7251-4056-ace9-20dbecca60ca]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f1ab43-aeda-4646-8a8b-74f95710bf62]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]
Nov 14 14:37:13 user nova-compute[75292]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.
Nov 14 14:37:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf0b297-f35a-42a2-b2bb-13202df622f8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== disconnect_volume: return (331ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:13 user nova-compute[75292]: WARNING nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state active and task_state None.
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:13 user nova-compute[75292]: WARNING nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state resize_migrating.
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:13 user nova-compute[75292]: WARNING nova.compute.manager [req-5cc6bdf0-2550-4027-ab2a-aef9c38061be req-bfd7942c-127e-46a3-a780-804eab00352b service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state resize_migrating.
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:37:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.policy [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb1e97d9f26d4b6581e3c8461b9b5590', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd4ea2ebbfce4ad3b2f94d34a0ecd9c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:37:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Creating image(s)
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7_resize/disk /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.209s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.165s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk 1073741824" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Cannot resize image /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Ensure instance console log exists: /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7_resize/disk /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk" returned: 0 in 0.950s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7_resize/disk.info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk.info {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7_resize/disk.info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk.info" returned: 0 in 0.031s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Successfully created port: c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Successfully updated port: c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:37:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing instance network info cache due to event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Port 681ed373-e78f-4440-9658-ae5f20726f63 binding to destination host user is already ACTIVE {{(pid=75292) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance network_info: |[{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.neutron [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Start _get_guest_xml network_info=[{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:37:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1101039281',display_name='tempest-ServerStableDeviceRescueTest-server-1101039281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1101039281',id=17,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHebnVQS6FKvNF+wx3CgvjfoGurhBvBEYNi0m1NZpNycK+s9g88yhFnWyRIXs30QEGidB46jkt5hBj7CYDe5yZT8G0ZxFj/sDeK6FJM8iYWgXhKaUnWIJTU1oqWUd2vq5A==',key_name='tempest-keypair-899067751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd4ea2ebbfce4ad3b2f94d34a0ecd9c9',ramdisk_id='',reservation_id='r-dzy4ans0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1897188969',owner_user_name='tempest-ServerStableDeviceRescueTest-1897188969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e97d9f26d4b6581e3c8461b9b5590',uuid=48cc4550-2634-4291-a55b-e66338585160,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converting VIF {"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'pci_devices' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:37:16 user nova-compute[75292]:   <uuid>48cc4550-2634-4291-a55b-e66338585160</uuid>
Nov 14 14:37:16 user nova-compute[75292]:   <name>instance-00000011</name>
Nov 14 14:37:16 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:37:16 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:37:16 user nova-compute[75292]:   <metadata>
Nov 14 14:37:16 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:37:16 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:37:16 user nova-compute[75292]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1101039281</nova:name>
Nov 14 14:37:16 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:37:16</nova:creationTime>
Nov 14 14:37:16 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:37:16 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:37:16 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:37:16 user nova-compute[75292]:       <nova:owner>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:user uuid="eb1e97d9f26d4b6581e3c8461b9b5590">tempest-ServerStableDeviceRescueTest-1897188969-project-member</nova:user>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:project uuid="dd4ea2ebbfce4ad3b2f94d34a0ecd9c9">tempest-ServerStableDeviceRescueTest-1897188969</nova:project>
Nov 14 14:37:16 user nova-compute[75292]:       </nova:owner>
Nov 14 14:37:16 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:37:16 user nova-compute[75292]:       <nova:ports>
Nov 14 14:37:16 user nova-compute[75292]:         <nova:port uuid="c1259aab-5d16-453a-9a2a-43fc1b982a07">
Nov 14 14:37:16 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:37:16 user nova-compute[75292]:         </nova:port>
Nov 14 14:37:16 user nova-compute[75292]:       </nova:ports>
Nov 14 14:37:16 user nova-compute[75292]:     </nova:instance>
Nov 14 14:37:16 user nova-compute[75292]:   </metadata>
Nov 14 14:37:16 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:37:16 user nova-compute[75292]:     <system>
Nov 14 14:37:16 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:37:16 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:37:16 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:37:16 user nova-compute[75292]:       <entry name="serial">48cc4550-2634-4291-a55b-e66338585160</entry>
Nov 14 14:37:16 user nova-compute[75292]:       <entry name="uuid">48cc4550-2634-4291-a55b-e66338585160</entry>
Nov 14 14:37:16 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:37:16 user nova-compute[75292]:     </system>
Nov 14 14:37:16 user nova-compute[75292]:   </sysinfo>
Nov 14 14:37:16 user nova-compute[75292]:   <os>
Nov 14 14:37:16 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:37:16 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:37:16 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:37:16 user nova-compute[75292]:   </os>
Nov 14 14:37:16 user nova-compute[75292]:   <features>
Nov 14 14:37:16 user nova-compute[75292]:     <acpi/>
Nov 14 14:37:16 user nova-compute[75292]:     <apic/>
Nov 14 14:37:16 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:37:16 user nova-compute[75292]:   </features>
Nov 14 14:37:16 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:37:16 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:37:16 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:37:16 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:37:16 user nova-compute[75292]:   </clock>
Nov 14 14:37:16 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:37:16 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:37:16 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:37:16 user nova-compute[75292]:   </cpu>
Nov 14 14:37:16 user nova-compute[75292]:   <devices>
Nov 14 14:37:16 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:37:16 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:37:16 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk"/>
Nov 14 14:37:16 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:37:16 user nova-compute[75292]:     </disk>
Nov 14 14:37:16 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:37:16 user nova-compute[75292]:       <mac address="fa:16:3e:8e:61:19"/>
Nov 14 14:37:16 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:16 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:37:16 user nova-compute[75292]:       <target dev="tapc1259aab-5d"/>
Nov 14 14:37:16 user nova-compute[75292]:     </interface>
Nov 14 14:37:16 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:37:16 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/console.log" append="off"/>
Nov 14 14:37:16 user nova-compute[75292]:     </serial>
Nov 14 14:37:16 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:37:16 user nova-compute[75292]:     <video>
Nov 14 14:37:16 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:16 user nova-compute[75292]:     </video>
Nov 14 14:37:16 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:37:16 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:37:16 user nova-compute[75292]:     </rng>
Nov 14 14:37:16 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:37:16 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:37:16 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:37:16 user nova-compute[75292]:     </memballoon>
Nov 14 14:37:16 user nova-compute[75292]:   </devices>
Nov 14 14:37:16 user nova-compute[75292]: </domain>
Nov 14 14:37:16 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1101039281',display_name='tempest-ServerStableDeviceRescueTest-server-1101039281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1101039281',id=17,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHebnVQS6FKvNF+wx3CgvjfoGurhBvBEYNi0m1NZpNycK+s9g88yhFnWyRIXs30QEGidB46jkt5hBj7CYDe5yZT8G0ZxFj/sDeK6FJM8iYWgXhKaUnWIJTU1oqWUd2vq5A==',key_name='tempest-keypair-899067751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd4ea2ebbfce4ad3b2f94d34a0ecd9c9',ramdisk_id='',reservation_id='r-dzy4ans0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1897188969',owner_user_name='tempest-ServerStableDeviceRescueTest-1897188969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e97d9f26d4b6581e3c8461b9b5590',uuid=48cc4550-2634-4291-a55b-e66338585160,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converting VIF {"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG os_vif [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c5eba4f-799e-5e4c-923e-f93ced2598a8', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1259aab-5d, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1259aab-5d, col_values=(('qos', UUID('686177a3-b4c3-44ac-9cd4-aecb5c8988e7')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1259aab-5d, col_values=(('external_ids', {'iface-id': 'c1259aab-5d16-453a-9a2a-43fc1b982a07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:61:19', 'vm-uuid': '48cc4550-2634-4291-a55b-e66338585160'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:16 user nova-compute[75292]: INFO os_vif [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d')
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No VIF found with MAC fa:16:3e:8e:61:19, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updated VIF entry in instance network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1af8cf08-c3fc-4d5a-8879-30c20803a6bb req-e3f72f39-d764-4e2a-8b6d-81c065b4cfb4 service nova] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG os_brick.utils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8aecc8b-ee24-49b9-af19-062f1e41ef18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e049010-2ffc-45e3-9f4b-0aaf50ab4cb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[249c75d3-bf0a-4d25-b695-d71d9f5b9177]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40862d2-b5b9-4f48-be99-0602c6a76c0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:37:17 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:37:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c606bd41-d6b7-454f-b832-7194f49a549a]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG os_brick.utils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-3bbc2397-0033-4c5e-bdb7-016dd3a293b1 req-a3d974d5-bb49-4fd1-bacb-6c2a955d2c8d service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bbc2397-0033-4c5e-bdb7-016dd3a293b1 req-a3d974d5-bb49-4fd1-bacb-6c2a955d2c8d service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bbc2397-0033-4c5e-bdb7-016dd3a293b1 req-a3d974d5-bb49-4fd1-bacb-6c2a955d2c8d service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bbc2397-0033-4c5e-bdb7-016dd3a293b1 req-a3d974d5-bb49-4fd1-bacb-6c2a955d2c8d service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-3bbc2397-0033-4c5e-bdb7-016dd3a293b1 req-a3d974d5-bb49-4fd1-bacb-6c2a955d2c8d service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:18 user nova-compute[75292]: WARNING nova.compute.manager [req-3bbc2397-0033-4c5e-bdb7-016dd3a293b1 req-a3d974d5-bb49-4fd1-bacb-6c2a955d2c8d service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state building and task_state spawning.
Nov 14 14:37:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-ef3d0e7d-7ddd-40db-9896-2e0ccd71c55b req-d0cfe57f-4ecd-4493-ba02-398234a544d8 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ef3d0e7d-7ddd-40db-9896-2e0ccd71c55b req-d0cfe57f-4ecd-4493-ba02-398234a544d8 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ef3d0e7d-7ddd-40db-9896-2e0ccd71c55b req-d0cfe57f-4ecd-4493-ba02-398234a544d8 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ef3d0e7d-7ddd-40db-9896-2e0ccd71c55b req-d0cfe57f-4ecd-4493-ba02-398234a544d8 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-ef3d0e7d-7ddd-40db-9896-2e0ccd71c55b req-d0cfe57f-4ecd-4493-ba02-398234a544d8 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:20 user nova-compute[75292]: WARNING nova.compute.manager [req-ef3d0e7d-7ddd-40db-9896-2e0ccd71c55b req-d0cfe57f-4ecd-4493-ba02-398234a544d8 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state building and task_state spawning.
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:37:20 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance spawned successfully.
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:20 user nova-compute[75292]: INFO nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Took 6.66 seconds to spawn the instance on the hypervisor.
Nov 14 14:37:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:37:20 user nova-compute[75292]: INFO nova.compute.manager [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Took 8.49 seconds to build instance.
Nov 14 14:37:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f7348a83-e03c-43f9-ba6e-60d9f15591e4 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.712s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Starting finish_migration {{(pid=75292) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 14:37:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:37:22 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Creating image(s)
Nov 14 14:37:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk. size=21474836480 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk 21474836480 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk 21474836480" returned: 0 in 0.069s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Ensure instance console log exists: /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start _get_guest_xml network_info=[{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4d1c2deb-b2aa-4ac4-bf9b-4684ca9d85fd', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c5ce2080-b527-4c87-b422-6de3f2d0c4d7', 'attached_at': '2023-11-14T14:37:23.000000', 'detached_at': '', 'volume_id': '4512e466-37fd-4d88-9657-b502c397bd35', 'serial': '4512e466-37fd-4d88-9657-b502c397bd35'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:37:23 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:23 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:37:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:37:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:37:23 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[790d3a7f-2892-40c2-8043-e6d50df051d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:37:23 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25b995-8809-48f5-bbe0-074470426ed0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35] added
Nov 14 14:37:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a125f3-1ca6-4bea-99c9-e13480ac56ee]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb5ca6-53d7-423f-a59f-c3c53e6dbbbb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSuPnEzO {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSuPnEzO" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6172da-02cd-4a9b-befc-ce8e938dccae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSuPnEzO'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da7692a-600d-4956-9035-0a6801ceaf61]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c67fc3-5d30-4257-b9d8-1cf1d6bf9f43]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:37:23 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:37:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:37:23 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:37:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 14:37:23 user nova-compute[75292]: 
Nov 14 14:37:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[464b46ad-8d6c-43e9-9e42-5b564d21731e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]
Nov 14 14:37:24 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.
Nov 14 14:37:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db23c6ca-05f0-46eb-8f0e-02f12b02db5e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9193f8-4629-410f-8c6f-bdbb8dc1d902]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:37:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:37:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b090df39-da59-443a-bdb3-988c5d73c12d]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:37:24 user nova-compute[75292]: INFO nova.compute.claims [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Claim successful on node user
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26434323532303937', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434323532303937', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:37:25 user nova-compute[75292]:   <uuid>c5ce2080-b527-4c87-b422-6de3f2d0c4d7</uuid>
Nov 14 14:37:25 user nova-compute[75292]:   <name>instance-00000002</name>
Nov 14 14:37:25 user nova-compute[75292]:   <memory>2097152</memory>
Nov 14 14:37:25 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:37:25 user nova-compute[75292]:   <metadata>
Nov 14 14:37:25 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:37:25 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:37:25 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherB-server-2014877484</nova:name>
Nov 14 14:37:25 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:37:23</nova:creationTime>
Nov 14 14:37:25 user nova-compute[75292]:       <nova:flavor name="m1.small">
Nov 14 14:37:25 user nova-compute[75292]:         <nova:memory>2048</nova:memory>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:disk>20</nova:disk>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:37:25 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:37:25 user nova-compute[75292]:       <nova:owner>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:user uuid="44e3e41e693f47bdae15a362ba3d5344">tempest-ServerActionsTestOtherB-1910038092-project-member</nova:user>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:project uuid="34612ba41d07410b8d6f934e759f0073">tempest-ServerActionsTestOtherB-1910038092</nova:project>
Nov 14 14:37:25 user nova-compute[75292]:       </nova:owner>
Nov 14 14:37:25 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:37:25 user nova-compute[75292]:       <nova:ports>
Nov 14 14:37:25 user nova-compute[75292]:         <nova:port uuid="681ed373-e78f-4440-9658-ae5f20726f63">
Nov 14 14:37:25 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:37:25 user nova-compute[75292]:         </nova:port>
Nov 14 14:37:25 user nova-compute[75292]:       </nova:ports>
Nov 14 14:37:25 user nova-compute[75292]:     </nova:instance>
Nov 14 14:37:25 user nova-compute[75292]:   </metadata>
Nov 14 14:37:25 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:37:25 user nova-compute[75292]:     <system>
Nov 14 14:37:25 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:37:25 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:37:25 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:37:25 user nova-compute[75292]:       <entry name="serial">c5ce2080-b527-4c87-b422-6de3f2d0c4d7</entry>
Nov 14 14:37:25 user nova-compute[75292]:       <entry name="uuid">c5ce2080-b527-4c87-b422-6de3f2d0c4d7</entry>
Nov 14 14:37:25 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:37:25 user nova-compute[75292]:     </system>
Nov 14 14:37:25 user nova-compute[75292]:   </sysinfo>
Nov 14 14:37:25 user nova-compute[75292]:   <os>
Nov 14 14:37:25 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:37:25 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:37:25 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:37:25 user nova-compute[75292]:   </os>
Nov 14 14:37:25 user nova-compute[75292]:   <features>
Nov 14 14:37:25 user nova-compute[75292]:     <acpi/>
Nov 14 14:37:25 user nova-compute[75292]:     <apic/>
Nov 14 14:37:25 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:37:25 user nova-compute[75292]:   </features>
Nov 14 14:37:25 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:37:25 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:37:25 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:37:25 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:37:25 user nova-compute[75292]:   </clock>
Nov 14 14:37:25 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:37:25 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:37:25 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:37:25 user nova-compute[75292]:   </cpu>
Nov 14 14:37:25 user nova-compute[75292]:   <devices>
Nov 14 14:37:25 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:37:25 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:37:25 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk"/>
Nov 14 14:37:25 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:37:25 user nova-compute[75292]:     </disk>
Nov 14 14:37:25 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:37:25 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:37:25 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:37:25 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:37:25 user nova-compute[75292]:       <serial>4512e466-37fd-4d88-9657-b502c397bd35</serial>
Nov 14 14:37:25 user nova-compute[75292]:     </disk>
Nov 14 14:37:25 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:37:25 user nova-compute[75292]:       <mac address="fa:16:3e:73:d7:5d"/>
Nov 14 14:37:25 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:25 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:37:25 user nova-compute[75292]:       <target dev="tap681ed373-e7"/>
Nov 14 14:37:25 user nova-compute[75292]:     </interface>
Nov 14 14:37:25 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:37:25 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/console.log" append="off"/>
Nov 14 14:37:25 user nova-compute[75292]:     </serial>
Nov 14 14:37:25 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:37:25 user nova-compute[75292]:     <video>
Nov 14 14:37:25 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:25 user nova-compute[75292]:     </video>
Nov 14 14:37:25 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:37:25 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:37:25 user nova-compute[75292]:     </rng>
Nov 14 14:37:25 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:37:25 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:37:25 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:37:25 user nova-compute[75292]:     </memballoon>
Nov 14 14:37:25 user nova-compute[75292]:   </devices>
Nov 14 14:37:25 user nova-compute[75292]: </domain>
Nov 14 14:37:25 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1770419626-network", "vif_mac": "fa:16:3e:73:d7:5d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG os_vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f9440f1-1d40-52fc-b258-491074a03491', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap681ed373-e7, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap681ed373-e7, col_values=(('qos', UUID('db6a1ed0-704f-4564-9679-f8e1b38e0244')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap681ed373-e7, col_values=(('external_ids', {'iface-id': '681ed373-e78f-4440-9658-ae5f20726f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:d7:5d', 'vm-uuid': 'c5ce2080-b527-4c87-b422-6de3f2d0c4d7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:25 user nova-compute[75292]: INFO os_vif [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7')
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.network.neutron [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:37:25 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] No VIF found with MAC fa:16:3e:73:d7:5d, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.policy [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '533cc5752e5b4fe2b9b2f2b91bd4259a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444dc84dbece41c6b22a37008eeb40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:37:25 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Creating image(s)
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "/opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "/opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.210s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.225s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk 1073741824" returned: 0 in 0.093s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG nova.network.neutron [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Successfully created port: c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.224s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Cannot resize image /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Ensure instance console log exists: /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:26 user nova-compute[75292]: DEBUG nova.network.neutron [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Successfully updated port: c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquired lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.neutron [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.neutron [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-changed-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Refreshing instance network info cache due to event network-changed-c8de9946-2e06-4bab-853a-808befc4ef9e. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] Acquiring lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.neutron [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Updating instance_info_cache with network_info: [{"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Releasing lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Instance network_info: |[{"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] Acquired lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.neutron [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Refreshing network info cache for port c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Start _get_guest_xml network_info=[{"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:37:27 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:27 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505661428',display_name='tempest-ServersNegativeTestJSON-server-505661428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505661428',id=18,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444dc84dbece41c6b22a37008eeb40e6',ramdisk_id='',reservation_id='r-89iq04tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1575597503',owner_user_name='tempest-ServersNegativeTestJSON-1575597503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:25Z,user_data=None,user_id='533cc5752e5b4fe2b9b2f2b91bd4259a',uuid=c5a143c2-8994-4297-91b2-b64ffa4e77f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converting VIF {"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.objects.instance [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lazy-loading 'pci_devices' on Instance uuid c5a143c2-8994-4297-91b2-b64ffa4e77f7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-3bfa5c5e-0bb7-4b3f-95e8-ef0fe6513e98 req-4b604d5d-3f62-4279-9321-23c1ebe7ae27 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bfa5c5e-0bb7-4b3f-95e8-ef0fe6513e98 req-4b604d5d-3f62-4279-9321-23c1ebe7ae27 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bfa5c5e-0bb7-4b3f-95e8-ef0fe6513e98 req-4b604d5d-3f62-4279-9321-23c1ebe7ae27 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bfa5c5e-0bb7-4b3f-95e8-ef0fe6513e98 req-4b604d5d-3f62-4279-9321-23c1ebe7ae27 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-3bfa5c5e-0bb7-4b3f-95e8-ef0fe6513e98 req-4b604d5d-3f62-4279-9321-23c1ebe7ae27 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:27 user nova-compute[75292]: WARNING nova.compute.manager [req-3bfa5c5e-0bb7-4b3f-95e8-ef0fe6513e98 req-4b604d5d-3f62-4279-9321-23c1ebe7ae27 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state resize_finish.
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:37:27 user nova-compute[75292]:   <uuid>c5a143c2-8994-4297-91b2-b64ffa4e77f7</uuid>
Nov 14 14:37:27 user nova-compute[75292]:   <name>instance-00000012</name>
Nov 14 14:37:27 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:37:27 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:37:27 user nova-compute[75292]:   <metadata>
Nov 14 14:37:27 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:37:27 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:37:27 user nova-compute[75292]:       <nova:name>tempest-ServersNegativeTestJSON-server-505661428</nova:name>
Nov 14 14:37:27 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:37:27</nova:creationTime>
Nov 14 14:37:27 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:37:27 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:37:27 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:37:27 user nova-compute[75292]:       <nova:owner>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:user uuid="533cc5752e5b4fe2b9b2f2b91bd4259a">tempest-ServersNegativeTestJSON-1575597503-project-member</nova:user>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:project uuid="444dc84dbece41c6b22a37008eeb40e6">tempest-ServersNegativeTestJSON-1575597503</nova:project>
Nov 14 14:37:27 user nova-compute[75292]:       </nova:owner>
Nov 14 14:37:27 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:37:27 user nova-compute[75292]:       <nova:ports>
Nov 14 14:37:27 user nova-compute[75292]:         <nova:port uuid="c8de9946-2e06-4bab-853a-808befc4ef9e">
Nov 14 14:37:27 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 14:37:27 user nova-compute[75292]:         </nova:port>
Nov 14 14:37:27 user nova-compute[75292]:       </nova:ports>
Nov 14 14:37:27 user nova-compute[75292]:     </nova:instance>
Nov 14 14:37:27 user nova-compute[75292]:   </metadata>
Nov 14 14:37:27 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:37:27 user nova-compute[75292]:     <system>
Nov 14 14:37:27 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:37:27 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:37:27 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:37:27 user nova-compute[75292]:       <entry name="serial">c5a143c2-8994-4297-91b2-b64ffa4e77f7</entry>
Nov 14 14:37:27 user nova-compute[75292]:       <entry name="uuid">c5a143c2-8994-4297-91b2-b64ffa4e77f7</entry>
Nov 14 14:37:27 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:37:27 user nova-compute[75292]:     </system>
Nov 14 14:37:27 user nova-compute[75292]:   </sysinfo>
Nov 14 14:37:27 user nova-compute[75292]:   <os>
Nov 14 14:37:27 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:37:27 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:37:27 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:37:27 user nova-compute[75292]:   </os>
Nov 14 14:37:27 user nova-compute[75292]:   <features>
Nov 14 14:37:27 user nova-compute[75292]:     <acpi/>
Nov 14 14:37:27 user nova-compute[75292]:     <apic/>
Nov 14 14:37:27 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:37:27 user nova-compute[75292]:   </features>
Nov 14 14:37:27 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:37:27 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:37:27 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:37:27 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:37:27 user nova-compute[75292]:   </clock>
Nov 14 14:37:27 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:37:27 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:37:27 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:37:27 user nova-compute[75292]:   </cpu>
Nov 14 14:37:27 user nova-compute[75292]:   <devices>
Nov 14 14:37:27 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:37:27 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:37:27 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk"/>
Nov 14 14:37:27 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:37:27 user nova-compute[75292]:     </disk>
Nov 14 14:37:27 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:37:27 user nova-compute[75292]:       <mac address="fa:16:3e:da:73:a8"/>
Nov 14 14:37:27 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:27 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:37:27 user nova-compute[75292]:       <target dev="tapc8de9946-2e"/>
Nov 14 14:37:27 user nova-compute[75292]:     </interface>
Nov 14 14:37:27 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:37:27 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/console.log" append="off"/>
Nov 14 14:37:27 user nova-compute[75292]:     </serial>
Nov 14 14:37:27 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:37:27 user nova-compute[75292]:     <video>
Nov 14 14:37:27 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:27 user nova-compute[75292]:     </video>
Nov 14 14:37:27 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:37:27 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:37:27 user nova-compute[75292]:     </rng>
Nov 14 14:37:27 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:37:27 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:37:27 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:37:27 user nova-compute[75292]:     </memballoon>
Nov 14 14:37:27 user nova-compute[75292]:   </devices>
Nov 14 14:37:27 user nova-compute[75292]: </domain>
Nov 14 14:37:27 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505661428',display_name='tempest-ServersNegativeTestJSON-server-505661428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505661428',id=18,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444dc84dbece41c6b22a37008eeb40e6',ramdisk_id='',reservation_id='r-89iq04tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1575597503',owner_user_name='tempest-ServersNegativeTestJSON-1575597503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:37:25Z,user_data=None,user_id='533cc5752e5b4fe2b9b2f2b91bd4259a',uuid=c5a143c2-8994-4297-91b2-b64ffa4e77f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converting VIF {"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG os_vif [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cc69e79-f149-5fee-93c1-46943e6b8526', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8de9946-2e, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8de9946-2e, col_values=(('qos', UUID('10ced2c1-40a6-44fa-a03f-17b593f806c4')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8de9946-2e, col_values=(('external_ids', {'iface-id': 'c8de9946-2e06-4bab-853a-808befc4ef9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:73:a8', 'vm-uuid': 'c5a143c2-8994-4297-91b2-b64ffa4e77f7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: INFO os_vif [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e')
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] No VIF found with MAC fa:16:3e:da:73:a8, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:28 user nova-compute[75292]: DEBUG nova.network.neutron [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Updated VIF entry in instance network info cache for port c8de9946-2e06-4bab-853a-808befc4ef9e. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:37:28 user nova-compute[75292]: DEBUG nova.network.neutron [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Updating instance_info_cache with network_info: [{"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ea870ddd-22ea-4c3f-b7af-cc161ae361e8 req-12c496c1-d0f5-446f-8424-fb8cae929ec5 service nova] Releasing lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fa0b89d1-7ec2-4993-b41b-4a701859e5cf req-bb29160e-eee5-44de-80a5-923b12692605 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa0b89d1-7ec2-4993-b41b-4a701859e5cf req-bb29160e-eee5-44de-80a5-923b12692605 service nova] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa0b89d1-7ec2-4993-b41b-4a701859e5cf req-bb29160e-eee5-44de-80a5-923b12692605 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa0b89d1-7ec2-4993-b41b-4a701859e5cf req-bb29160e-eee5-44de-80a5-923b12692605 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fa0b89d1-7ec2-4993-b41b-4a701859e5cf req-bb29160e-eee5-44de-80a5-923b12692605 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] No waiting events found dispatching network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:29 user nova-compute[75292]: WARNING nova.compute.manager [req-fa0b89d1-7ec2-4993-b41b-4a701859e5cf req-bb29160e-eee5-44de-80a5-923b12692605 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received unexpected event network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e for instance with vm_state building and task_state spawning.
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:37:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance running successfully.
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Failed to set time: agent not configured {{(pid=75292) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5a80c1e9-d332-4b78-9a0b-589024af5b87 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] finish_migration finished successfully. {{(pid=75292) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-8f7ac475-8000-4666-879a-25d671d3434c req-dd18c474-6f9c-4d9b-b320-f67403cc919d service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8f7ac475-8000-4666-879a-25d671d3434c req-dd18c474-6f9c-4d9b-b320-f67403cc919d service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8f7ac475-8000-4666-879a-25d671d3434c req-dd18c474-6f9c-4d9b-b320-f67403cc919d service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8f7ac475-8000-4666-879a-25d671d3434c req-dd18c474-6f9c-4d9b-b320-f67403cc919d service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-8f7ac475-8000-4666-879a-25d671d3434c req-dd18c474-6f9c-4d9b-b320-f67403cc919d service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:29 user nova-compute[75292]: WARNING nova.compute.manager [req-8f7ac475-8000-4666-879a-25d671d3434c req-dd18c474-6f9c-4d9b-b320-f67403cc919d service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state resize_finish.
Nov 14 14:37:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-4d307071-16ce-4ff7-b317-9b76dcb91f91 req-cf226d06-7df4-4c44-9131-89b7aab7dcf0 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4d307071-16ce-4ff7-b317-9b76dcb91f91 req-cf226d06-7df4-4c44-9131-89b7aab7dcf0 service nova] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4d307071-16ce-4ff7-b317-9b76dcb91f91 req-cf226d06-7df4-4c44-9131-89b7aab7dcf0 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4d307071-16ce-4ff7-b317-9b76dcb91f91 req-cf226d06-7df4-4c44-9131-89b7aab7dcf0 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-4d307071-16ce-4ff7-b317-9b76dcb91f91 req-cf226d06-7df4-4c44-9131-89b7aab7dcf0 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] No waiting events found dispatching network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:31 user nova-compute[75292]: WARNING nova.compute.manager [req-4d307071-16ce-4ff7-b317-9b76dcb91f91 req-cf226d06-7df4-4c44-9131-89b7aab7dcf0 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received unexpected event network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e for instance with vm_state building and task_state spawning.
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:37:31 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Instance spawned successfully.
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:37:31 user nova-compute[75292]: INFO nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 14 14:37:31 user nova-compute[75292]: DEBUG nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:37:31 user nova-compute[75292]: INFO nova.compute.manager [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Took 7.29 seconds to build instance.
Nov 14 14:37:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-161031ee-939e-49e5-81e3-e930138df251 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.412s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:54 user nova-compute[75292]: INFO nova.compute.manager [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Rescuing
Nov 14 14:37:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:37:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:37:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:37:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:55 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance destroyed successfully.
Nov 14 14:37:55 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Attempting rescue
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75292) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:37:55 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Creating image(s)
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue" returned: 0 in 0.052s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'migration_context' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.base [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<e5865b32-ff16-4409-9130-4ac985de81ca> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Start _get_guest_xml network_info=[{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:67:e1:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'resources' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.base [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<e5865b32-ff16-4409-9130-4ac985de81ca> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'numa_topology' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:55 user nova-compute[75292]: DEBUG nova.objects.base [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<e5865b32-ff16-4409-9130-4ac985de81ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:37:56 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:56 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.objects.base [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<e5865b32-ff16-4409-9130-4ac985de81ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1903340639',display_name='tempest-ServerRescueNegativeTestJSON-server-1903340639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1903340639',id=1,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-rbudekua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:33:31Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=e5865b32-ff16-4409-9130-4ac985de81ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:67:e1:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:67:e1:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'pci_devices' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.objects.base [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<e5865b32-ff16-4409-9130-4ac985de81ca> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:37:56 user nova-compute[75292]:   <uuid>e5865b32-ff16-4409-9130-4ac985de81ca</uuid>
Nov 14 14:37:56 user nova-compute[75292]:   <name>instance-00000001</name>
Nov 14 14:37:56 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:37:56 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:37:56 user nova-compute[75292]:   <metadata>
Nov 14 14:37:56 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:37:56 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:37:56 user nova-compute[75292]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1903340639</nova:name>
Nov 14 14:37:56 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:37:56</nova:creationTime>
Nov 14 14:37:56 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:37:56 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:37:56 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:37:56 user nova-compute[75292]:       <nova:owner>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:user uuid="9970be0d6d0a4c7193237192da054e8c">tempest-ServerRescueNegativeTestJSON-1737174677-project-member</nova:user>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:project uuid="850c4eb7326f46c59998de50b99686c0">tempest-ServerRescueNegativeTestJSON-1737174677</nova:project>
Nov 14 14:37:56 user nova-compute[75292]:       </nova:owner>
Nov 14 14:37:56 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:37:56 user nova-compute[75292]:       <nova:ports>
Nov 14 14:37:56 user nova-compute[75292]:         <nova:port uuid="81d5c23c-2743-4ba8-a05f-a5c91722f552">
Nov 14 14:37:56 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 14:37:56 user nova-compute[75292]:         </nova:port>
Nov 14 14:37:56 user nova-compute[75292]:       </nova:ports>
Nov 14 14:37:56 user nova-compute[75292]:     </nova:instance>
Nov 14 14:37:56 user nova-compute[75292]:   </metadata>
Nov 14 14:37:56 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:37:56 user nova-compute[75292]:     <system>
Nov 14 14:37:56 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:37:56 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:37:56 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:37:56 user nova-compute[75292]:       <entry name="serial">e5865b32-ff16-4409-9130-4ac985de81ca</entry>
Nov 14 14:37:56 user nova-compute[75292]:       <entry name="uuid">e5865b32-ff16-4409-9130-4ac985de81ca</entry>
Nov 14 14:37:56 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:37:56 user nova-compute[75292]:     </system>
Nov 14 14:37:56 user nova-compute[75292]:   </sysinfo>
Nov 14 14:37:56 user nova-compute[75292]:   <os>
Nov 14 14:37:56 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:37:56 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:37:56 user nova-compute[75292]:   </os>
Nov 14 14:37:56 user nova-compute[75292]:   <features>
Nov 14 14:37:56 user nova-compute[75292]:     <acpi/>
Nov 14 14:37:56 user nova-compute[75292]:     <apic/>
Nov 14 14:37:56 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:37:56 user nova-compute[75292]:   </features>
Nov 14 14:37:56 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:37:56 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:37:56 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:37:56 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:37:56 user nova-compute[75292]:   </clock>
Nov 14 14:37:56 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:37:56 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:37:56 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:37:56 user nova-compute[75292]:   </cpu>
Nov 14 14:37:56 user nova-compute[75292]:   <devices>
Nov 14 14:37:56 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:37:56 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:37:56 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue"/>
Nov 14 14:37:56 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:37:56 user nova-compute[75292]:     </disk>
Nov 14 14:37:56 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:37:56 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:37:56 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk"/>
Nov 14 14:37:56 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:37:56 user nova-compute[75292]:     </disk>
Nov 14 14:37:56 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:37:56 user nova-compute[75292]:       <mac address="fa:16:3e:67:e1:18"/>
Nov 14 14:37:56 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:56 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:37:56 user nova-compute[75292]:       <target dev="tap81d5c23c-27"/>
Nov 14 14:37:56 user nova-compute[75292]:     </interface>
Nov 14 14:37:56 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:37:56 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/console.log" append="off"/>
Nov 14 14:37:56 user nova-compute[75292]:     </serial>
Nov 14 14:37:56 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:37:56 user nova-compute[75292]:     <video>
Nov 14 14:37:56 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:37:56 user nova-compute[75292]:     </video>
Nov 14 14:37:56 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:37:56 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:37:56 user nova-compute[75292]:     </rng>
Nov 14 14:37:56 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:37:56 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:37:56 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:37:56 user nova-compute[75292]:     </memballoon>
Nov 14 14:37:56 user nova-compute[75292]:   </devices>
Nov 14 14:37:56 user nova-compute[75292]: </domain>
Nov 14 14:37:56 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:37:56 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance destroyed successfully.
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:67:e1:18, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:37:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-fdfc3443-daa4-4ce8-942e-e661613450b2 req-d06eb756-56db-47a0-ba58-52dc5d53c13e service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fdfc3443-daa4-4ce8-942e-e661613450b2 req-d06eb756-56db-47a0-ba58-52dc5d53c13e service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fdfc3443-daa4-4ce8-942e-e661613450b2 req-d06eb756-56db-47a0-ba58-52dc5d53c13e service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fdfc3443-daa4-4ce8-942e-e661613450b2 req-d06eb756-56db-47a0-ba58-52dc5d53c13e service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-fdfc3443-daa4-4ce8-942e-e661613450b2 req-d06eb756-56db-47a0-ba58-52dc5d53c13e service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:57 user nova-compute[75292]: WARNING nova.compute.manager [req-fdfc3443-daa4-4ce8-942e-e661613450b2 req-d06eb756-56db-47a0-ba58-52dc5d53c13e service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state active and task_state rescuing.
Nov 14 14:37:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:59 user nova-compute[75292]: WARNING nova.compute.manager [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state active and task_state rescuing.
Nov 14 14:37:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:37:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:37:59 user nova-compute[75292]: WARNING nova.compute.manager [req-fad10401-f37e-4146-8f20-4b6a3f6df651 req-92233999-0013-4c91-a796-939ff90838c1 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state active and task_state rescuing.
Nov 14 14:37:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b5c668f-5789-4bb1-90eb-5769fd014cd9 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:38:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a468bdfa-d2a6-49d1-b190-16d44497d3a8 req-efa4dacf-fabf-44dd-89fc-b864ac58094b service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a468bdfa-d2a6-49d1-b190-16d44497d3a8 req-efa4dacf-fabf-44dd-89fc-b864ac58094b service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a468bdfa-d2a6-49d1-b190-16d44497d3a8 req-efa4dacf-fabf-44dd-89fc-b864ac58094b service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a468bdfa-d2a6-49d1-b190-16d44497d3a8 req-efa4dacf-fabf-44dd-89fc-b864ac58094b service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a468bdfa-d2a6-49d1-b190-16d44497d3a8 req-efa4dacf-fabf-44dd-89fc-b864ac58094b service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:01 user nova-compute[75292]: WARNING nova.compute.manager [req-a468bdfa-d2a6-49d1-b190-16d44497d3a8 req-efa4dacf-fabf-44dd-89fc-b864ac58094b service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state rescued and task_state None.
Nov 14 14:38:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updating instance_info_cache with network_info: [{"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-44726e61-672d-42a1-81ae-489cb41dc49e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:38:04 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:38:06 user nova-compute[75292]: INFO nova.compute.claims [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Claim successful on node user
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:38:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:38:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG nova.policy [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9563ec83e8234bd4b057bf302223bacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '554d69574dda4f5d912b17e57a98f116', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:38:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Creating image(s)
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "/opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "/opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "/opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.220s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.220s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk 1073741824" returned: 0 in 0.069s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.220s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Successfully created port: e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Cannot resize image /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Ensure instance console log exists: /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Successfully updated port: e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "refresh_cache-27d6dec7-0948-4b9c-9325-50e8212b5fb9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquired lock "refresh_cache-27d6dec7-0948-4b9c-9325-50e8212b5fb9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-changed-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Refreshing instance network info cache due to event network-changed-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] Acquiring lock "refresh_cache-27d6dec7-0948-4b9c-9325-50e8212b5fb9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:38:08 user nova-compute[75292]: INFO nova.compute.claims [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Claim successful on node user
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Updating instance_info_cache with network_info: [{"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Releasing lock "refresh_cache-27d6dec7-0948-4b9c-9325-50e8212b5fb9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Instance network_info: |[{"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] Acquired lock "refresh_cache-27d6dec7-0948-4b9c-9325-50e8212b5fb9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Refreshing network info cache for port e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Start _get_guest_xml network_info=[{"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:38:09 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:09 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-706148200',display_name='tempest-DeleteServersTestJSON-server-706148200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-706148200',id=19,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='554d69574dda4f5d912b17e57a98f116',ramdisk_id='',reservation_id='r-o0py11er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-414981124',owner_user_name='tempest-DeleteServersTestJSON-414981124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:38:07Z,user_data=None,user_id='9563ec83e8234bd4b057bf302223bacf',uuid=27d6dec7-0948-4b9c-9325-50e8212b5fb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Converting VIF {"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lazy-loading 'pci_devices' on Instance uuid 27d6dec7-0948-4b9c-9325-50e8212b5fb9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:38:09 user nova-compute[75292]:   <uuid>27d6dec7-0948-4b9c-9325-50e8212b5fb9</uuid>
Nov 14 14:38:09 user nova-compute[75292]:   <name>instance-00000013</name>
Nov 14 14:38:09 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:38:09 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:38:09 user nova-compute[75292]:   <metadata>
Nov 14 14:38:09 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:38:09 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:38:09 user nova-compute[75292]:       <nova:name>tempest-DeleteServersTestJSON-server-706148200</nova:name>
Nov 14 14:38:09 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:38:09</nova:creationTime>
Nov 14 14:38:09 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:38:09 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:38:09 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:38:09 user nova-compute[75292]:       <nova:owner>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:user uuid="9563ec83e8234bd4b057bf302223bacf">tempest-DeleteServersTestJSON-414981124-project-member</nova:user>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:project uuid="554d69574dda4f5d912b17e57a98f116">tempest-DeleteServersTestJSON-414981124</nova:project>
Nov 14 14:38:09 user nova-compute[75292]:       </nova:owner>
Nov 14 14:38:09 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:38:09 user nova-compute[75292]:       <nova:ports>
Nov 14 14:38:09 user nova-compute[75292]:         <nova:port uuid="e6ff3be2-bd97-42d0-8946-fa6bd520f0e8">
Nov 14 14:38:09 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:38:09 user nova-compute[75292]:         </nova:port>
Nov 14 14:38:09 user nova-compute[75292]:       </nova:ports>
Nov 14 14:38:09 user nova-compute[75292]:     </nova:instance>
Nov 14 14:38:09 user nova-compute[75292]:   </metadata>
Nov 14 14:38:09 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:38:09 user nova-compute[75292]:     <system>
Nov 14 14:38:09 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:38:09 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:38:09 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:38:09 user nova-compute[75292]:       <entry name="serial">27d6dec7-0948-4b9c-9325-50e8212b5fb9</entry>
Nov 14 14:38:09 user nova-compute[75292]:       <entry name="uuid">27d6dec7-0948-4b9c-9325-50e8212b5fb9</entry>
Nov 14 14:38:09 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:38:09 user nova-compute[75292]:     </system>
Nov 14 14:38:09 user nova-compute[75292]:   </sysinfo>
Nov 14 14:38:09 user nova-compute[75292]:   <os>
Nov 14 14:38:09 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:38:09 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:38:09 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:38:09 user nova-compute[75292]:   </os>
Nov 14 14:38:09 user nova-compute[75292]:   <features>
Nov 14 14:38:09 user nova-compute[75292]:     <acpi/>
Nov 14 14:38:09 user nova-compute[75292]:     <apic/>
Nov 14 14:38:09 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:38:09 user nova-compute[75292]:   </features>
Nov 14 14:38:09 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:38:09 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:38:09 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:38:09 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:38:09 user nova-compute[75292]:   </clock>
Nov 14 14:38:09 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:38:09 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:38:09 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:38:09 user nova-compute[75292]:   </cpu>
Nov 14 14:38:09 user nova-compute[75292]:   <devices>
Nov 14 14:38:09 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:38:09 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:38:09 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk"/>
Nov 14 14:38:09 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:38:09 user nova-compute[75292]:     </disk>
Nov 14 14:38:09 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:38:09 user nova-compute[75292]:       <mac address="fa:16:3e:58:4d:4f"/>
Nov 14 14:38:09 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:38:09 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:38:09 user nova-compute[75292]:       <target dev="tape6ff3be2-bd"/>
Nov 14 14:38:09 user nova-compute[75292]:     </interface>
Nov 14 14:38:09 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:38:09 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/console.log" append="off"/>
Nov 14 14:38:09 user nova-compute[75292]:     </serial>
Nov 14 14:38:09 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:38:09 user nova-compute[75292]:     <video>
Nov 14 14:38:09 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:38:09 user nova-compute[75292]:     </video>
Nov 14 14:38:09 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:38:09 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:38:09 user nova-compute[75292]:     </rng>
Nov 14 14:38:09 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:38:09 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:38:09 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:38:09 user nova-compute[75292]:     </memballoon>
Nov 14 14:38:09 user nova-compute[75292]:   </devices>
Nov 14 14:38:09 user nova-compute[75292]: </domain>
Nov 14 14:38:09 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-706148200',display_name='tempest-DeleteServersTestJSON-server-706148200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-706148200',id=19,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='554d69574dda4f5d912b17e57a98f116',ramdisk_id='',reservation_id='r-o0py11er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-414981124',owner_user_name='tempest-DeleteServersTestJSON-414981124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:38:07Z,user_data=None,user_id='9563ec83e8234bd4b057bf302223bacf',uuid=27d6dec7-0948-4b9c-9325-50e8212b5fb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Converting VIF {"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG os_vif [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79d85122-0034-570c-8229-8db8de87ed0f', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6ff3be2-bd, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6ff3be2-bd, col_values=(('qos', UUID('d714d17f-ee11-494b-984f-ab008a2d7412')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6ff3be2-bd, col_values=(('external_ids', {'iface-id': 'e6ff3be2-bd97-42d0-8946-fa6bd520f0e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:4d:4f', 'vm-uuid': '27d6dec7-0948-4b9c-9325-50e8212b5fb9'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:09 user nova-compute[75292]: INFO os_vif [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd')
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] No VIF found with MAC fa:16:3e:58:4d:4f, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.903s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Updated VIF entry in instance network info cache for port e6ff3be2-bd97-42d0-8946-fa6bd520f0e8. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Updating instance_info_cache with network_info: [{"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dc959b02-23a6-466c-b98e-b0f5ee010878 req-4c0f2a14-04e5-4f69-976e-074c7a224f0e service nova] Releasing lock "refresh_cache-27d6dec7-0948-4b9c-9325-50e8212b5fb9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:38:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:38:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:38:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Creating image(s)
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "a9593e658786bdc81fb00df0dd976f0eec95f30c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "a9593e658786bdc81fb00df0dd976f0eec95f30c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG nova.policy [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f20ed29c2964cf5bc164dc614dcb97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4452a2c5ea7451997f344226737bf38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.634s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG nova.virt.images [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] 30789dba-62a6-4cf2-a865-f871f696c6f0 was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.part /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.part /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.converted" returned: 0 in 0.216s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c.converted --force-share --output=json" returned: 0 in 0.251s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "a9593e658786bdc81fb00df0dd976f0eec95f30c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.199s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-4798e1e7-7334-4a31-b902-588c89623897 req-a02200fb-1672-4a7e-977e-28b4520ff06d service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4798e1e7-7334-4a31-b902-588c89623897 req-a02200fb-1672-4a7e-977e-28b4520ff06d service nova] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4798e1e7-7334-4a31-b902-588c89623897 req-a02200fb-1672-4a7e-977e-28b4520ff06d service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4798e1e7-7334-4a31-b902-588c89623897 req-a02200fb-1672-4a7e-977e-28b4520ff06d service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-4798e1e7-7334-4a31-b902-588c89623897 req-a02200fb-1672-4a7e-977e-28b4520ff06d service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] No waiting events found dispatching network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:11 user nova-compute[75292]: WARNING nova.compute.manager [req-4798e1e7-7334-4a31-b902-588c89623897 req-a02200fb-1672-4a7e-977e-28b4520ff06d service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received unexpected event network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 for instance with vm_state building and task_state spawning.
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json" returned: 0 in 0.201s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "a9593e658786bdc81fb00df0dd976f0eec95f30c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "a9593e658786bdc81fb00df0dd976f0eec95f30c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json" returned: 0 in 0.224s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c,backing_fmt=raw /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Successfully created port: fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c,backing_fmt=raw /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk 1073741824" returned: 0 in 0.059s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "a9593e658786bdc81fb00df0dd976f0eec95f30c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Successfully updated port: fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] No waiting events found dispatching network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:13 user nova-compute[75292]: WARNING nova.compute.manager [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received unexpected event network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 for instance with vm_state building and task_state spawning.
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing instance network info cache due to event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.network.neutron [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json" returned: 0 in 1.966s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "c1a64402-744c-443f-b6d2-f29e0022b992" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:13 user nova-compute[75292]: INFO nova.compute.manager [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Terminating instance
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:38:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Instance spawned successfully.
Nov 14 14:38:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=25.486709594726562GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Cannot resize image /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Ensure instance console log exists: /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Took 6.97 seconds to spawn the instance on the hypervisor.
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Applying migration context for instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 as it has an incoming, in-progress migration bec59af2-1bb3-48e7-8795-428797abbc85. Migration status is finished {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating resource usage from migration bec59af2-1bb3-48e7-8795-428797abbc85
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 44726e61-672d-42a1-81ae-489cb41dc49e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c1a64402-744c-443f-b6d2-f29e0022b992 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Migration bec59af2-1bb3-48e7-8795-428797abbc85 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 27d6dec7-0948-4b9c-9325-50e8212b5fb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.compute.manager [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Took 8.15 seconds to build instance.
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-895b2d99-fa2e-4c08-b75f-1a373ead4158 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.261s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-93d2582b-1f95-4603-8acc-8077137cad11 req-e52bab73-c63b-41a9-a941-b9d4cfa7d17c service nova] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Instance destroyed successfully.
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'resources' on Instance uuid c1a64402-744c-443f-b6d2-f29e0022b992 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-795698347',display_name='tempest-VolumesAdminNegativeTest-server-795698347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-795698347',id=14,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='892f3598b451430aa15c1f92e1c21aaa',ramdisk_id='',reservation_id='r-bpgsn2qv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1045564970',owner_user_name='tempest-VolumesAdminNegativeTest-1045564970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:36:24Z,user_data=None,user_id='1f6816e7810246f39c569b568d2be333',uuid=c1a64402-744c-443f-b6d2-f29e0022b992,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converting VIF {"id": "85891cca-afc8-4564-9967-aa01032a65f6", "address": "fa:16:3e:f9:e9:79", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85891cca-af", "ovs_interfaceid": "85891cca-afc8-4564-9967-aa01032a65f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG os_vif [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85891cca-af, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bbb93f0-26f6-4d41-b9ba-f35f3be7de8b) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:14 user nova-compute[75292]: INFO os_vif [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:e9:79,bridge_name='br-int',has_traffic_filtering=True,id=85891cca-afc8-4564-9967-aa01032a65f6,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85891cca-af')
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Deleting instance files /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992_del
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Deletion of /opt/stack/data/nova/instances/c1a64402-744c-443f-b6d2-f29e0022b992_del complete
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.compute.manager [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.930s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.352s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:38:14 user nova-compute[75292]: INFO nova.compute.claims [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Claim successful on node user
Nov 14 14:38:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance network_info: |[{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Start _get_guest_xml network_info=[{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:38:05Z,direct_url=<?>,disk_format='qcow2',id=30789dba-62a6-4cf2-a865-f871f696c6f0,min_disk=0,min_ram=0,name='tempest-scenario-img--1946786042',owner='d4452a2c5ea7451997f344226737bf38',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:38:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '30789dba-62a6-4cf2-a865-f871f696c6f0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:38:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:38:05Z,direct_url=<?>,disk_format='qcow2',id=30789dba-62a6-4cf2-a865-f871f696c6f0,min_disk=0,min_ram=0,name='tempest-scenario-img--1946786042',owner='d4452a2c5ea7451997f344226737bf38',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:38:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517126303',display_name='tempest-TestMinimumBasicScenario-server-1517126303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517126303',id=20,image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt2ywkWaNq23mGaooT+uHlWwwF9vKnixAx9vlSB9Q+NH/mta3IUdPVfprVjztpV2oEZGR1682f2+QsXbgBCUqyOv5ngZDC8JDUuZQKtpzMw3ekrQHi9AjN7o6iH3rdSsg==',key_name='tempest-TestMinimumBasicScenario-1832686439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-qbxoq5lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:38:10Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=7397dbe8-471b-40b2-8dea-cc8078a92a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.objects.instance [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'pci_devices' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:38:15 user nova-compute[75292]:   <uuid>7397dbe8-471b-40b2-8dea-cc8078a92a77</uuid>
Nov 14 14:38:15 user nova-compute[75292]:   <name>instance-00000014</name>
Nov 14 14:38:15 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:38:15 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:38:15 user nova-compute[75292]:   <metadata>
Nov 14 14:38:15 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:38:15 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:38:15 user nova-compute[75292]:       <nova:name>tempest-TestMinimumBasicScenario-server-1517126303</nova:name>
Nov 14 14:38:15 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:38:15</nova:creationTime>
Nov 14 14:38:15 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:38:15 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:38:15 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:38:15 user nova-compute[75292]:       <nova:owner>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:user uuid="8f20ed29c2964cf5bc164dc614dcb97c">tempest-TestMinimumBasicScenario-364849145-project-member</nova:user>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:project uuid="d4452a2c5ea7451997f344226737bf38">tempest-TestMinimumBasicScenario-364849145</nova:project>
Nov 14 14:38:15 user nova-compute[75292]:       </nova:owner>
Nov 14 14:38:15 user nova-compute[75292]:       <nova:root type="image" uuid="30789dba-62a6-4cf2-a865-f871f696c6f0"/>
Nov 14 14:38:15 user nova-compute[75292]:       <nova:ports>
Nov 14 14:38:15 user nova-compute[75292]:         <nova:port uuid="fea62a5d-74a2-4285-80fc-85b092e61f1a">
Nov 14 14:38:15 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 14:38:15 user nova-compute[75292]:         </nova:port>
Nov 14 14:38:15 user nova-compute[75292]:       </nova:ports>
Nov 14 14:38:15 user nova-compute[75292]:     </nova:instance>
Nov 14 14:38:15 user nova-compute[75292]:   </metadata>
Nov 14 14:38:15 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:38:15 user nova-compute[75292]:     <system>
Nov 14 14:38:15 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:38:15 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:38:15 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:38:15 user nova-compute[75292]:       <entry name="serial">7397dbe8-471b-40b2-8dea-cc8078a92a77</entry>
Nov 14 14:38:15 user nova-compute[75292]:       <entry name="uuid">7397dbe8-471b-40b2-8dea-cc8078a92a77</entry>
Nov 14 14:38:15 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:38:15 user nova-compute[75292]:     </system>
Nov 14 14:38:15 user nova-compute[75292]:   </sysinfo>
Nov 14 14:38:15 user nova-compute[75292]:   <os>
Nov 14 14:38:15 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:38:15 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:38:15 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:38:15 user nova-compute[75292]:   </os>
Nov 14 14:38:15 user nova-compute[75292]:   <features>
Nov 14 14:38:15 user nova-compute[75292]:     <acpi/>
Nov 14 14:38:15 user nova-compute[75292]:     <apic/>
Nov 14 14:38:15 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:38:15 user nova-compute[75292]:   </features>
Nov 14 14:38:15 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:38:15 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:38:15 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:38:15 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:38:15 user nova-compute[75292]:   </clock>
Nov 14 14:38:15 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:38:15 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:38:15 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:38:15 user nova-compute[75292]:   </cpu>
Nov 14 14:38:15 user nova-compute[75292]:   <devices>
Nov 14 14:38:15 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:38:15 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:38:15 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk"/>
Nov 14 14:38:15 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:38:15 user nova-compute[75292]:     </disk>
Nov 14 14:38:15 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:38:15 user nova-compute[75292]:       <mac address="fa:16:3e:fe:e0:43"/>
Nov 14 14:38:15 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:38:15 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:38:15 user nova-compute[75292]:       <target dev="tapfea62a5d-74"/>
Nov 14 14:38:15 user nova-compute[75292]:     </interface>
Nov 14 14:38:15 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:38:15 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/console.log" append="off"/>
Nov 14 14:38:15 user nova-compute[75292]:     </serial>
Nov 14 14:38:15 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:38:15 user nova-compute[75292]:     <video>
Nov 14 14:38:15 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:38:15 user nova-compute[75292]:     </video>
Nov 14 14:38:15 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:38:15 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:38:15 user nova-compute[75292]:     </rng>
Nov 14 14:38:15 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:38:15 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:38:15 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:38:15 user nova-compute[75292]:     </memballoon>
Nov 14 14:38:15 user nova-compute[75292]:   </devices>
Nov 14 14:38:15 user nova-compute[75292]: </domain>
Nov 14 14:38:15 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517126303',display_name='tempest-TestMinimumBasicScenario-server-1517126303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517126303',id=20,image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt2ywkWaNq23mGaooT+uHlWwwF9vKnixAx9vlSB9Q+NH/mta3IUdPVfprVjztpV2oEZGR1682f2+QsXbgBCUqyOv5ngZDC8JDUuZQKtpzMw3ekrQHi9AjN7o6iH3rdSsg==',key_name='tempest-TestMinimumBasicScenario-1832686439',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-qbxoq5lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:38:10Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=7397dbe8-471b-40b2-8dea-cc8078a92a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG os_vif [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a1ee8f6-b002-5a8a-af24-1752a5048676', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfea62a5d-74, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfea62a5d-74, col_values=(('qos', UUID('b5986fa6-15bf-40d7-aabc-0da6d02ad210')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfea62a5d-74, col_values=(('external_ids', {'iface-id': 'fea62a5d-74a2-4285-80fc-85b092e61f1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:e0:43', 'vm-uuid': '7397dbe8-471b-40b2-8dea-cc8078a92a77'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:15 user nova-compute[75292]: INFO os_vif [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74')
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:15 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Took 0.56 seconds to deallocate network for instance.
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-3e27ca9e-29e8-438d-8259-c2c2e7605049 req-ffe779a9-4644-48de-b52a-f4869ca8c07a service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received event network-vif-deleted-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:15 user nova-compute[75292]: INFO nova.compute.manager [req-3e27ca9e-29e8-438d-8259-c2c2e7605049 req-ffe779a9-4644-48de-b52a-f4869ca8c07a service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Neutron deleted interface 85891cca-afc8-4564-9967-aa01032a65f6; detaching it from the instance and deleting it from the info cache
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-3e27ca9e-29e8-438d-8259-c2c2e7605049 req-ffe779a9-4644-48de-b52a-f4869ca8c07a service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No VIF found with MAC fa:16:3e:fe:e0:43, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-3e27ca9e-29e8-438d-8259-c2c2e7605049 req-ffe779a9-4644-48de-b52a-f4869ca8c07a service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Detach interface failed, port_id=85891cca-afc8-4564-9967-aa01032a65f6, reason: Instance c1a64402-744c-443f-b6d2-f29e0022b992 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received event network-vif-unplugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] No waiting events found dispatching network-vif-unplugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:15 user nova-compute[75292]: WARNING nova.compute.manager [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received unexpected event network-vif-unplugged-85891cca-afc8-4564-9967-aa01032a65f6 for instance with vm_state deleted and task_state None.
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received event network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] Acquiring lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] Lock "c1a64402-744c-443f-b6d2-f29e0022b992-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] No waiting events found dispatching network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:15 user nova-compute[75292]: WARNING nova.compute.manager [req-01cb59d8-cbed-4cce-8c7b-f9cfa6a53ce9 req-06060954-4d5c-4d09-a12c-f5eb9527986e service nova] [instance: c1a64402-744c-443f-b6d2-f29e0022b992] Received unexpected event network-vif-plugged-85891cca-afc8-4564-9967-aa01032a65f6 for instance with vm_state deleted and task_state None.
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.275s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:38:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.policy [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f9145d6e9f947d78220d587fe76fa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f4b849d66445b847310e31ebb139e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:38:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Creating image(s)
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.211s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk 1073741824" returned: 0 in 0.082s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:16 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Deleted allocations for instance c1a64402-744c-443f-b6d2-f29e0022b992
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Successfully created port: a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e0da6f74-168c-4d2c-ac80-2bdb63ad2993 tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "c1a64402-744c-443f-b6d2-f29e0022b992" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.564s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Cannot resize image /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Ensure instance console log exists: /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:38:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Successfully updated port: a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquired lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-changed-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Refreshing instance network info cache due to event network-changed-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] Acquiring lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Releasing lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Instance network_info: |[{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] Acquired lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Refreshing network info cache for port a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Start _get_guest_xml network_info=[{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:38:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:17 user nova-compute[75292]: WARNING nova.compute.manager [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state building and task_state spawning.
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:17 user nova-compute[75292]: WARNING nova.compute.manager [req-043086f0-3812-4908-a838-6fc4a473f49c req-d0c550ff-d4a1-404e-ad4f-de48862a37eb service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state building and task_state spawning.
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:38:17 user nova-compute[75292]:   <uuid>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</uuid>
Nov 14 14:38:17 user nova-compute[75292]:   <name>instance-00000015</name>
Nov 14 14:38:17 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:38:17 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:38:17 user nova-compute[75292]:   <metadata>
Nov 14 14:38:17 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:38:17 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:38:17 user nova-compute[75292]:       <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:38:17 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:38:17</nova:creationTime>
Nov 14 14:38:17 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:38:17 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:38:17 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:38:17 user nova-compute[75292]:       <nova:owner>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:38:17 user nova-compute[75292]:       </nova:owner>
Nov 14 14:38:17 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:38:17 user nova-compute[75292]:       <nova:ports>
Nov 14 14:38:17 user nova-compute[75292]:         <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:38:17 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:38:17 user nova-compute[75292]:         </nova:port>
Nov 14 14:38:17 user nova-compute[75292]:       </nova:ports>
Nov 14 14:38:17 user nova-compute[75292]:     </nova:instance>
Nov 14 14:38:17 user nova-compute[75292]:   </metadata>
Nov 14 14:38:17 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:38:17 user nova-compute[75292]:     <system>
Nov 14 14:38:17 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:38:17 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:38:17 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:38:17 user nova-compute[75292]:       <entry name="serial">6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:38:17 user nova-compute[75292]:       <entry name="uuid">6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:38:17 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:38:17 user nova-compute[75292]:     </system>
Nov 14 14:38:17 user nova-compute[75292]:   </sysinfo>
Nov 14 14:38:17 user nova-compute[75292]:   <os>
Nov 14 14:38:17 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:38:17 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:38:17 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:38:17 user nova-compute[75292]:   </os>
Nov 14 14:38:17 user nova-compute[75292]:   <features>
Nov 14 14:38:17 user nova-compute[75292]:     <acpi/>
Nov 14 14:38:17 user nova-compute[75292]:     <apic/>
Nov 14 14:38:17 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:38:17 user nova-compute[75292]:   </features>
Nov 14 14:38:17 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:38:17 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:38:17 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:38:17 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:38:17 user nova-compute[75292]:   </clock>
Nov 14 14:38:17 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:38:17 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:38:17 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:38:17 user nova-compute[75292]:   </cpu>
Nov 14 14:38:17 user nova-compute[75292]:   <devices>
Nov 14 14:38:17 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:38:17 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:38:17 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk"/>
Nov 14 14:38:17 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:38:17 user nova-compute[75292]:     </disk>
Nov 14 14:38:17 user nova-compute[75292]:     <disk type="file" device="cdrom">
Nov 14 14:38:17 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 14:38:17 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config"/>
Nov 14 14:38:17 user nova-compute[75292]:       <target dev="hda" bus="ide"/>
Nov 14 14:38:17 user nova-compute[75292]:     </disk>
Nov 14 14:38:17 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:38:17 user nova-compute[75292]:       <mac address="fa:16:3e:0c:00:22"/>
Nov 14 14:38:17 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:38:17 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:38:17 user nova-compute[75292]:       <target dev="tapa34295b5-1a"/>
Nov 14 14:38:17 user nova-compute[75292]:     </interface>
Nov 14 14:38:17 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:38:17 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log" append="off"/>
Nov 14 14:38:17 user nova-compute[75292]:     </serial>
Nov 14 14:38:17 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:38:17 user nova-compute[75292]:     <video>
Nov 14 14:38:17 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:38:17 user nova-compute[75292]:     </video>
Nov 14 14:38:17 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:38:17 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:38:17 user nova-compute[75292]:     </rng>
Nov 14 14:38:17 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:38:17 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:38:17 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:38:17 user nova-compute[75292]:     </memballoon>
Nov 14 14:38:17 user nova-compute[75292]:   </devices>
Nov 14 14:38:17 user nova-compute[75292]: </domain>
Nov 14 14:38:17 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG os_vif [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42482c6f-ffa9-52ac-a5e3-5ee2b2637b66', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa34295b5-1a, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa34295b5-1a, col_values=(('qos', UUID('055cf80f-ae9b-44c2-be83-c703b2dcb5ee')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa34295b5-1a, col_values=(('external_ids', {'iface-id': 'a34295b5-1ac7-44b4-b7a6-1a0a12232f5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:00:22', 'vm-uuid': '6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:17 user nova-compute[75292]: INFO os_vif [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a')
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No BDM found with device name hda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:38:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No VIF found with MAC fa:16:3e:0c:00:22, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:38:17 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Using config drive
Nov 14 14:38:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Creating config drive at /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config
Nov 14 14:38:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcrhmc0ym {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpcrhmc0ym" returned: 0 in 0.057s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updated VIF entry in instance network info cache for port a34295b5-1ac7-44b4-b7a6-1a0a12232f5c. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-00aba593-2934-4fd7-85d3-9dd342c6d73b req-01b6bc9c-ecf1-4762-ac1a-6dd62144cd2b service nova] Releasing lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:38:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance spawned successfully.
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:19 user nova-compute[75292]: INFO nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Took 8.88 seconds to spawn the instance on the hypervisor.
Nov 14 14:38:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:38:19 user nova-compute[75292]: INFO nova.compute.manager [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Took 10.26 seconds to build instance.
Nov 14 14:38:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-28176d51-4b19-4e2d-8a01-ce43308e050c tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.400s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-d63142da-87c4-4598-b6ed-72e97e5ce987 req-9456eee1-518a-46e3-8899-7de30dab513c service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d63142da-87c4-4598-b6ed-72e97e5ce987 req-9456eee1-518a-46e3-8899-7de30dab513c service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d63142da-87c4-4598-b6ed-72e97e5ce987 req-9456eee1-518a-46e3-8899-7de30dab513c service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d63142da-87c4-4598-b6ed-72e97e5ce987 req-9456eee1-518a-46e3-8899-7de30dab513c service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-d63142da-87c4-4598-b6ed-72e97e5ce987 req-9456eee1-518a-46e3-8899-7de30dab513c service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:19 user nova-compute[75292]: WARNING nova.compute.manager [req-d63142da-87c4-4598-b6ed-72e97e5ce987 req-9456eee1-518a-46e3-8899-7de30dab513c service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c for instance with vm_state building and task_state spawning.
Nov 14 14:38:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-fc550c56-d710-4f3a-937e-1b9ba0dfd618 req-debea914-db62-47d2-9e5c-c5f578ce19d0 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fc550c56-d710-4f3a-937e-1b9ba0dfd618 req-debea914-db62-47d2-9e5c-c5f578ce19d0 service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fc550c56-d710-4f3a-937e-1b9ba0dfd618 req-debea914-db62-47d2-9e5c-c5f578ce19d0 service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fc550c56-d710-4f3a-937e-1b9ba0dfd618 req-debea914-db62-47d2-9e5c-c5f578ce19d0 service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-fc550c56-d710-4f3a-937e-1b9ba0dfd618 req-debea914-db62-47d2-9e5c-c5f578ce19d0 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:21 user nova-compute[75292]: WARNING nova.compute.manager [req-fc550c56-d710-4f3a-937e-1b9ba0dfd618 req-debea914-db62-47d2-9e5c-c5f578ce19d0 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c for instance with vm_state building and task_state spawning.
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:38:21 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Instance spawned successfully.
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:38:22 user nova-compute[75292]: INFO nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 14 14:38:22 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:38:22 user nova-compute[75292]: INFO nova.compute.manager [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Took 7.72 seconds to build instance.
Nov 14 14:38:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4349f64b-9eeb-43cb-be00-f6419d54e7d4 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.846s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:42 user nova-compute[75292]: INFO nova.compute.manager [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Terminating instance
Nov 14 14:38:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-90344e10-0b85-4492-abb5-6e6d65b52ded req-c1749c27-5ccf-48f5-80d4-39f42f1d5a2a service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-vif-unplugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-90344e10-0b85-4492-abb5-6e6d65b52ded req-c1749c27-5ccf-48f5-80d4-39f42f1d5a2a service nova] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-90344e10-0b85-4492-abb5-6e6d65b52ded req-c1749c27-5ccf-48f5-80d4-39f42f1d5a2a service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-90344e10-0b85-4492-abb5-6e6d65b52ded req-c1749c27-5ccf-48f5-80d4-39f42f1d5a2a service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-90344e10-0b85-4492-abb5-6e6d65b52ded req-c1749c27-5ccf-48f5-80d4-39f42f1d5a2a service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] No waiting events found dispatching network-vif-unplugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-90344e10-0b85-4492-abb5-6e6d65b52ded req-c1749c27-5ccf-48f5-80d4-39f42f1d5a2a service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-vif-unplugged-d6a44490-3bb5-4984-aec2-df9c44c0154c for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:38:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Instance destroyed successfully.
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.objects.instance [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lazy-loading 'resources' on Instance uuid 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-42417043',display_name='tempest-VolumesActionsTest-instance-42417043',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-42417043',id=15,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:36:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a8c84debb904cc5b4798f3abc42c05e',ramdisk_id='',reservation_id='r-j0c5vme0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1975132646',owner_user_name='tempest-VolumesActionsTest-1975132646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:36:59Z,user_data=None,user_id='eaeef475e0554905982ae3762b4e1be6',uuid=81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converting VIF {"id": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "address": "fa:16:3e:b4:c5:30", "network": {"id": "bdd48537-f660-4dda-af3e-c28c455cc968", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1717723199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a8c84debb904cc5b4798f3abc42c05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6a44490-3b", "ovs_interfaceid": "d6a44490-3bb5-4984-aec2-df9c44c0154c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG os_vif [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6a44490-3b, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6c23996-463f-4c6a-88cb-57ec5655069e) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:43 user nova-compute[75292]: INFO os_vif [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c5:30,bridge_name='br-int',has_traffic_filtering=True,id=d6a44490-3bb5-4984-aec2-df9c44c0154c,network=Network(bdd48537-f660-4dda-af3e-c28c455cc968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6a44490-3b')
Nov 14 14:38:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Deleting instance files /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b_del
Nov 14 14:38:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Deletion of /opt/stack/data/nova/instances/81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b_del complete
Nov 14 14:38:43 user nova-compute[75292]: INFO nova.compute.manager [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 14 14:38:43 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:38:43 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:38:44 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:44 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Took 0.61 seconds to deallocate network for instance.
Nov 14 14:38:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:44 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:38:44 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:38:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:44 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Deleted allocations for instance 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b
Nov 14 14:38:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-11942595-f9f3-4c1c-bb83-bb0a24c12b2b tempest-VolumesActionsTest-1975132646 tempest-VolumesActionsTest-1975132646-project-member] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] Acquiring lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] Lock "81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] No waiting events found dispatching network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:45 user nova-compute[75292]: WARNING nova.compute.manager [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received unexpected event network-vif-plugged-d6a44490-3bb5-4984-aec2-df9c44c0154c for instance with vm_state deleted and task_state None.
Nov 14 14:38:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-7887b0ed-1624-4ff5-b5b7-2ef9e49e9f14 req-0500f393-4b95-4a20-aa44-d4ed39db39da service nova] [instance: 81d8f640-1ddb-4e7c-a4b4-2c68441f2b0b] Received event network-vif-deleted-d6a44490-3bb5-4984-aec2-df9c44c0154c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-changed-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Refreshing instance network info cache due to event network-changed-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:38:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] Acquiring lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] Acquired lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:53 user nova-compute[75292]: DEBUG nova.network.neutron [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Refreshing network info cache for port c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:38:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updated VIF entry in instance network info cache for port c3d85393-dc7a-40ef-84a8-0e7b69e8aaae. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating instance_info_cache with network_info: [{"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'flavor' on Instance uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5fa9b3a1-c845-4bd6-86cd-e8c210404a83 req-392b8431-d9f4-4ca5-b6e1-5cd9f585f5d5 service nova] Releasing lock "refresh_cache-e153ead2-1bf6-410b-9b0a-3c1bef1f8062" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.186s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:55 user nova-compute[75292]: INFO nova.compute.manager [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attaching volume 5050e2c4-4afb-4656-a981-27b11bd94664 to /dev/vdb
Nov 14 14:38:55 user nova-compute[75292]: DEBUG os_brick.utils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e58d88-3633-479e-a031-c8f4722ab981]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b64b3b-1491-438b-bb7f-ae79c839b52e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e1bfb-4b5f-4721-8e01-0b7a4274c551]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5098f2d3-afeb-427e-b101-8a55a1ffb43d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:38:55 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:38:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60498eb0-58e3-4ab7-9c8e-ab9f69c576c7]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG os_brick.utils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:38:55 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating existing volume attachment record: 0bdc2175-c723-4f1e-b961-63f53c650017 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Port 681ed373-e78f-4440-9658-ae5f20726f63 binding to destination host user is already ACTIVE {{(pid=75292) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Creating tmpfile /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/tmp76q9z0l1 to verify with other compute node that the instance is on the same shared storage. {{(pid=75292) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-9da23240-2a96-4c83-8210-b61a9e2f0731 req-893577b5-9c42-4ab2-827d-e26e0297fbcf service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9da23240-2a96-4c83-8210-b61a9e2f0731 req-893577b5-9c42-4ab2-827d-e26e0297fbcf service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9da23240-2a96-4c83-8210-b61a9e2f0731 req-893577b5-9c42-4ab2-827d-e26e0297fbcf service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9da23240-2a96-4c83-8210-b61a9e2f0731 req-893577b5-9c42-4ab2-827d-e26e0297fbcf service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-9da23240-2a96-4c83-8210-b61a9e2f0731 req-893577b5-9c42-4ab2-827d-e26e0297fbcf service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:38:58 user nova-compute[75292]: WARNING nova.compute.manager [req-9da23240-2a96-4c83-8210-b61a9e2f0731 req-893577b5-9c42-4ab2-827d-e26e0297fbcf service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state resized and task_state resize_reverting.
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance destroyed successfully.
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.objects.instance [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'resources' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:37:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap681ed373-e7, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db6a1ed0-704f-4564-9679-f8e1b38e0244) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:58 user nova-compute[75292]: INFO os_vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7')
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:38:58 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[006674d2-0779-42bb-bbab-c015d45fa71c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:38:58 user nova-compute[75292]: No targets found.
Nov 14 14:38:58 user nova-compute[75292]: iSNS:
Nov 14 14:38:58 user nova-compute[75292]: No targets found.
Nov 14 14:38:58 user nova-compute[75292]: STATIC:
Nov 14 14:38:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:38:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:38:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:38:58 user nova-compute[75292]: FIRMWARE:
Nov 14 14:38:58 user nova-compute[75292]: No targets found.
Nov 14 14:38:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:38:58 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:38:58 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de7e3e7-4a13-4bae-a49b-3e46da803bbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[58645e95-60fb-408b-8945-4114d639e7e7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:38:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:38:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b752f28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b4135-94b9-455a-bc2c-c5c5595fd45c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a88866-1ef9-42fc-af21-10efbae9c4c5]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ed7c85-2a37-4a31-b511-3cc4593f7f97]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f077dc92-5da8-4af2-873b-5f70f2ba84dd]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc1abb-765e-4608-a5ec-15e5011148c0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06536e1b-3086-442d-8e43-0fd6b29d5f7b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]
Nov 14 14:38:58 user nova-compute[75292]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.
Nov 14 14:38:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d771f955-c9e4-4948-8698-6c39e06d23b7]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== disconnect_volume: return (266ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:38:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:38:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:38:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:38:59 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e9ed0f-42f9-4d29-ba22-0fe96cf2dfe7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:38:59 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.091s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fb5167-24c8-443c-8c45-d2f8db233eaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664] added
Nov 14 14:38:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef57b29-0e58-40cc-b916-81c22da4c55d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5031f860-eb77-49cd-9f0e-8e87b261f5c3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUWrVhot {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUWrVhot" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c54486c-1c80-4ee7-ad4f-aeda2e763bc9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUWrVhot'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c203f9-8671-4f1b-a1b2-f2cc478fb21a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[477fbdc5-ba72-4fda-9544-f15eb87015ad]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:38:59 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:38:59 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:38:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 14:38:59 user nova-compute[75292]: 
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e0837-307a-4942-b356-ab95c63699b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]
Nov 14 14:38:59 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.
Nov 14 14:38:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG nova.objects.instance [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'migration_context' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG nova.objects.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Object Instance<c5ce2080-b527-4c87-b422-6de3f2d0c4d7> lazy-loaded attributes: resources,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eded202d-4236-4c6e-884f-185395143ead]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b10619-0d4a-4db9-8e65-36b7c6375608]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:38:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:38:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e7db5-d93b-4395-ada4-87485494cc2c]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:38:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-2f3ae51f-4656-4cc4-9b2b-c959a9d654af req-5e60cb28-ac19-4eb7-b3ca-55a42336b603 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2f3ae51f-4656-4cc4-9b2b-c959a9d654af req-5e60cb28-ac19-4eb7-b3ca-55a42336b603 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2f3ae51f-4656-4cc4-9b2b-c959a9d654af req-5e60cb28-ac19-4eb7-b3ca-55a42336b603 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2f3ae51f-4656-4cc4-9b2b-c959a9d654af req-5e60cb28-ac19-4eb7-b3ca-55a42336b603 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-2f3ae51f-4656-4cc4-9b2b-c959a9d654af req-5e60cb28-ac19-4eb7-b3ca-55a42336b603 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:00 user nova-compute[75292]: WARNING nova.compute.manager [req-2f3ae51f-4656-4cc4-9b2b-c959a9d654af req-5e60cb28-ac19-4eb7-b3ca-55a42336b603 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state resized and task_state resize_reverting.
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.475s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:00 user nova-compute[75292]: INFO nova.compute.manager [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Swapping old allocation on dict_keys(['09e514fa-427e-42ca-8897-f1a398f916a9']) held by migration bec59af2-1bb3-48e7-8795-428797abbc85 for instance
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Overwriting current allocation {'allocations': {'09e514fa-427e-42ca-8897-f1a398f916a9': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '34612ba41d07410b8d6f934e759f0073', 'user_id': '44e3e41e693f47bdae15a362ba3d5344', 'consumer_generation': 1} on consumer c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.network.neutron [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23135653835376263', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135653835376263', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.objects.instance [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'flavor' on Instance uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:39:00 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:39:00 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:39:00 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:39:00 user nova-compute[75292]:   <serial>5050e2c4-4afb-4656-a981-27b11bd94664</serial>
Nov 14 14:39:00 user nova-compute[75292]: </disk>
Nov 14 14:39:00 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG nova.network.neutron [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG os_brick.utils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee287b9a-e951-4898-a689-a8c63773f306]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b760d-d936-4479-93f9-5e726680ac82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee92148-e60c-4083-8636-465e906f2b76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4650535-7690-4a84-9879-ef3c1e4dbc79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:39:01 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[515367b4-4eb3-40fe-aa7f-946cb09644f5]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG os_brick.utils [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No VIF found with MAC fa:16:3e:cd:43:9e, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-964f3d04-6301-4b08-9741-41b6880e87bc tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.486s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing instance network info cache due to event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 14:39:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 14:39:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updated VIF entry in instance network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:39:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:39:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7946a499-11f8-4bfa-8656-d40ad1fad55e req-c3aca1b5-1a02-405c-b746-74d8b15bb8c1 service nova] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:39:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:39:02 user nova-compute[75292]: INFO nova.compute.manager [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] instance snapshotting
Nov 14 14:39:02 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Beginning live snapshot process
Nov 14 14:39:03 user nova-compute[75292]: INFO nova.compute.manager [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Rebuilding instance
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-24fbca6b-c87d-4b9a-935a-7ed9bdcb745a req-10cacafd-d645-42f3-9623-bb25713f6bb3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-unplugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-24fbca6b-c87d-4b9a-935a-7ed9bdcb745a req-10cacafd-d645-42f3-9623-bb25713f6bb3 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-24fbca6b-c87d-4b9a-935a-7ed9bdcb745a req-10cacafd-d645-42f3-9623-bb25713f6bb3 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-24fbca6b-c87d-4b9a-935a-7ed9bdcb745a req-10cacafd-d645-42f3-9623-bb25713f6bb3 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-24fbca6b-c87d-4b9a-935a-7ed9bdcb745a req-10cacafd-d645-42f3-9623-bb25713f6bb3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-unplugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:03 user nova-compute[75292]: WARNING nova.compute.manager [req-24fbca6b-c87d-4b9a-935a-7ed9bdcb745a req-10cacafd-d645-42f3-9623-bb25713f6bb3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-unplugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state active and task_state rebuilding.
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3167a6ao/089b1c513ae7424ba956b53e234d6eed.delta 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:39:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3167a6ao/089b1c513ae7424ba956b53e234d6eed.delta 1073741824" returned: 0 in 0.063s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 14:39:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:39:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance destroyed successfully.
Nov 14 14:39:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:39:04 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 14:39:04 user nova-compute[75292]: INFO nova.compute.manager [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Detaching volume 5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:39:05 user nova-compute[75292]: INFO nova.virt.block_device [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attempting to driver detach volume 5050e2c4-4afb-4656-a981-27b11bd94664 from mountpoint /dev/vdb
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Attempting to detach device vdb from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:39:05 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:39:05 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:39:05 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:39:05 user nova-compute[75292]:   <serial>5050e2c4-4afb-4656-a981-27b11bd94664</serial>
Nov 14 14:39:05 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:39:05 user nova-compute[75292]: </disk>
Nov 14 14:39:05 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:39:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully detached device vdb from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 from the persistent domain config.
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:05 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad28dab-5724-4ff5-b329-f1dab0017ec1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:39:05 user nova-compute[75292]: No targets found.
Nov 14 14:39:05 user nova-compute[75292]: iSNS:
Nov 14 14:39:05 user nova-compute[75292]: No targets found.
Nov 14 14:39:05 user nova-compute[75292]: STATIC:
Nov 14 14:39:05 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:39:05 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:39:05 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:39:05 user nova-compute[75292]: FIRMWARE:
Nov 14 14:39:05 user nova-compute[75292]: No targets found.
Nov 14 14:39:05 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:39:05 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:39:05 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[317acf69-1a30-44f3-adfd-9b6d28d8b6f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee3a835-a32b-4ee4-870c-9baa0952493d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:39:05 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:39:05 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b54620af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5521df-a725-4ec1-8dd2-2e72a986a81e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e7f136-7563-49b9-83d9-2cd67a97ad5c]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[02de0b67-4c4a-458a-aaa8-7b6f5da7684b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] COPY block job progress, current cursor: 20971520 final cursor: 75563008 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe26c1e-4c09-4b18-b661-4fee9d47ed45]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ccf06b-cea1-4b73-98fc-b3c4bd9db7ea]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87586dac-555c-4d1c-801d-a5be45401f57]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: INFO nova.compute.manager [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Terminating instance
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]
Nov 14 14:39:05 user nova-compute[75292]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.
Nov 14 14:39:05 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b24a2d6-62ce-4293-bf5b-e1de9ecb055f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== disconnect_volume: return (302ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-629c975b-ff75-4a53-9893-41374c127135 req-66e6ed5c-d8d7-4090-93c6-68ff3502dab0 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-629c975b-ff75-4a53-9893-41374c127135 req-66e6ed5c-d8d7-4090-93c6-68ff3502dab0 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-629c975b-ff75-4a53-9893-41374c127135 req-66e6ed5c-d8d7-4090-93c6-68ff3502dab0 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-629c975b-ff75-4a53-9893-41374c127135 req-66e6ed5c-d8d7-4090-93c6-68ff3502dab0 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-629c975b-ff75-4a53-9893-41374c127135 req-66e6ed5c-d8d7-4090-93c6-68ff3502dab0 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:05 user nova-compute[75292]: WARNING nova.compute.manager [req-629c975b-ff75-4a53-9893-41374c127135 req-66e6ed5c-d8d7-4090-93c6-68ff3502dab0 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state active and task_state rebuilding.
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-772a51b6-917d-49f1-a549-48116f02a9ae req-d10e293d-f84e-4ffe-b1e9-f70d85ad45e0 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-vif-unplugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-772a51b6-917d-49f1-a549-48116f02a9ae req-d10e293d-f84e-4ffe-b1e9-f70d85ad45e0 service nova] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-772a51b6-917d-49f1-a549-48116f02a9ae req-d10e293d-f84e-4ffe-b1e9-f70d85ad45e0 service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-772a51b6-917d-49f1-a549-48116f02a9ae req-d10e293d-f84e-4ffe-b1e9-f70d85ad45e0 service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-772a51b6-917d-49f1-a549-48116f02a9ae req-d10e293d-f84e-4ffe-b1e9-f70d85ad45e0 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] No waiting events found dispatching network-vif-unplugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-772a51b6-917d-49f1-a549-48116f02a9ae req-d10e293d-f84e-4ffe-b1e9-f70d85ad45e0 service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-vif-unplugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:39:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Starting finish_revert_migration {{(pid=75292) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start _get_guest_xml network_info=[{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e1a4432a-3d25-4d2b-92fd-52577ec4f930', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c5ce2080-b527-4c87-b422-6de3f2d0c4d7', 'attached_at': '2023-11-14T14:39:06.000000', 'detached_at': '', 'volume_id': '4512e466-37fd-4d88-9657-b502c397bd35', 'serial': '4512e466-37fd-4d88-9657-b502c397bd35'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:39:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:39:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'vcpu_model' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:39:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:39:06 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ae6556-63fa-47ae-a759-2c94c658ef74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:39:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d720150-86f3-4713-a470-fceb16c6c085]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35] added
Nov 14 14:39:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f81f0b5-d560-4e68-a6c3-0e3cf8adc5a1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Instance destroyed successfully.
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lazy-loading 'resources' on Instance uuid 44726e61-672d-42a1-81ae-489cb41dc49e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db801bcb-0fde-4ae0-8c39-4bd4841640ff]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3167a6ao/089b1c513ae7424ba956b53e234d6eed.delta /opt/stack/data/nova/instances/snapshots/tmp3167a6ao/089b1c513ae7424ba956b53e234d6eed {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSuPnEzO {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSuPnEzO" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[257177a0-1941-4c00-a25b-5ef8b6b721b3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1969466487',display_name='tempest-VolumesAdminNegativeTest-server-1969466487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1969466487',id=5,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIq3EAzOxeViNmBmbGYU3fJkD5qlKZnSK6JjyMXD9eF1fYIVL2nFemnBD28opzEMBzHeq3CpNRzsyDkX653rvFsGCgebyI3Vi4d2/rMCw+lpoiZjfwwJ5oxDHE0Y3DPydQ==',key_name='tempest-keypair-1154101494',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='892f3598b451430aa15c1f92e1c21aaa',ramdisk_id='',reservation_id='r-0nc7v9zj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1045564970',owner_user_name='tempest-VolumesAdminNegativeTest-1045564970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6816e7810246f39c569b568d2be333',uuid=44726e61-672d-42a1-81ae-489cb41dc49e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converting VIF {"id": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "address": "fa:16:3e:6f:07:d2", "network": {"id": "b432bcec-b33b-4380-8261-a3596c3b9374", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1622322849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "892f3598b451430aa15c1f92e1c21aaa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0113c6de-74", "ovs_interfaceid": "0113c6de-745c-4af7-8e3d-43ac3f4cba4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_vif [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSuPnEzO'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0113c6de-74, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b6a79-d8bc-4678-a472-1cccc4419bf4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f7a1841-7849-4f27-b54f-a338b3151bfe) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: INFO os_vif [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:07:d2,bridge_name='br-int',has_traffic_filtering=True,id=0113c6de-745c-4af7-8e3d-43ac3f4cba4e,network=Network(b432bcec-b33b-4380-8261-a3596c3b9374),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0113c6de-74')
Nov 14 14:39:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Deleting instance files /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e_del
Nov 14 14:39:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Deletion of /opt/stack/data/nova/instances/44726e61-672d-42a1-81ae-489cb41dc49e_del complete
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d392b-a153-4ebd-8d06-03e669597116]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:39:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 14:39:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:39:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 14:39:06 user nova-compute[75292]: 
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance destroyed successfully.
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-935294165',display_name='tempest-ServerActionsTestOtherA-server-1304088302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-935294165',id=16,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4PSWGM/1ftzwfDAUuYKxU/kl/E9ddsjcDHS5qvs1EZt9ShsPr19Pfa5LyW4urTLQ7G5FMF4MozVRL9Ox3bsqMTLxcdONv1cFJ8IQVNm7DDDavOofdZzJVSCkLE5kGTiQ==',key_name='tempest-keypair-1422090515',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-rfdcmkpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=e153ead2-1bf6-410b-9b0a-3c1bef1f8062,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d85393-dc, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8199b7c9-1a2b-4017-a73f-e997182c4a9d) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:06 user nova-compute[75292]: INFO os_vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc')
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --login" returned: 0 in 0.207s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[921be132-ac5f-4361-8a2b-0bb07927d7a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]
Nov 14 14:39:06 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.
Nov 14 14:39:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: INFO nova.compute.manager [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03d9382-e052-45e6-806c-bfadcc9623a5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b09316-b196-4d33-8378-0b38641f8fb9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d9de84-65ec-4070-8f1e-7e1b0bdbf9c0]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3167a6ao/089b1c513ae7424ba956b53e234d6eed.delta /opt/stack/data/nova/instances/snapshots/tmp3167a6ao/089b1c513ae7424ba956b53e234d6eed" returned: 0 in 0.527s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Snapshot extracted, beginning image upload
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:39:07 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Took 0.84 seconds to deallocate network for instance.
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.525s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== connect_volume: return (1527ms) {'type': 'block', 'scsi_wwn': '26434323532303937', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434323532303937', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.268s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2204aee2-e393-4cae-bd95-5d268e36cd11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:39:07 user nova-compute[75292]: No targets found.
Nov 14 14:39:07 user nova-compute[75292]: iSNS:
Nov 14 14:39:07 user nova-compute[75292]: No targets found.
Nov 14 14:39:07 user nova-compute[75292]: STATIC:
Nov 14 14:39:07 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:39:07 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:39:07 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:39:07 user nova-compute[75292]: FIRMWARE:
Nov 14 14:39:07 user nova-compute[75292]: No targets found.
Nov 14 14:39:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:39:07 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:39:07 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[316fe419-1907-4536-ad06-2597eba9cab9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:39:07 user nova-compute[75292]:   <uuid>c5ce2080-b527-4c87-b422-6de3f2d0c4d7</uuid>
Nov 14 14:39:07 user nova-compute[75292]:   <name>instance-00000002</name>
Nov 14 14:39:07 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:39:07 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:39:07 user nova-compute[75292]:   <metadata>
Nov 14 14:39:07 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:39:07 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:39:07 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherB-server-2014877484</nova:name>
Nov 14 14:39:07 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:39:06</nova:creationTime>
Nov 14 14:39:07 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:39:07 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:39:07 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:39:07 user nova-compute[75292]:       <nova:owner>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:user uuid="44e3e41e693f47bdae15a362ba3d5344">tempest-ServerActionsTestOtherB-1910038092-project-member</nova:user>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:project uuid="34612ba41d07410b8d6f934e759f0073">tempest-ServerActionsTestOtherB-1910038092</nova:project>
Nov 14 14:39:07 user nova-compute[75292]:       </nova:owner>
Nov 14 14:39:07 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:39:07 user nova-compute[75292]:       <nova:ports>
Nov 14 14:39:07 user nova-compute[75292]:         <nova:port uuid="681ed373-e78f-4440-9658-ae5f20726f63">
Nov 14 14:39:07 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:39:07 user nova-compute[75292]:         </nova:port>
Nov 14 14:39:07 user nova-compute[75292]:       </nova:ports>
Nov 14 14:39:07 user nova-compute[75292]:     </nova:instance>
Nov 14 14:39:07 user nova-compute[75292]:   </metadata>
Nov 14 14:39:07 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:39:07 user nova-compute[75292]:     <system>
Nov 14 14:39:07 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:39:07 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:39:07 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:39:07 user nova-compute[75292]:       <entry name="serial">c5ce2080-b527-4c87-b422-6de3f2d0c4d7</entry>
Nov 14 14:39:07 user nova-compute[75292]:       <entry name="uuid">c5ce2080-b527-4c87-b422-6de3f2d0c4d7</entry>
Nov 14 14:39:07 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:39:07 user nova-compute[75292]:     </system>
Nov 14 14:39:07 user nova-compute[75292]:   </sysinfo>
Nov 14 14:39:07 user nova-compute[75292]:   <os>
Nov 14 14:39:07 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:39:07 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:39:07 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:39:07 user nova-compute[75292]:   </os>
Nov 14 14:39:07 user nova-compute[75292]:   <features>
Nov 14 14:39:07 user nova-compute[75292]:     <acpi/>
Nov 14 14:39:07 user nova-compute[75292]:     <apic/>
Nov 14 14:39:07 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:39:07 user nova-compute[75292]:   </features>
Nov 14 14:39:07 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:39:07 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:39:07 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:39:07 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:39:07 user nova-compute[75292]:   </clock>
Nov 14 14:39:07 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:39:07 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:39:07 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:39:07 user nova-compute[75292]:   </cpu>
Nov 14 14:39:07 user nova-compute[75292]:   <devices>
Nov 14 14:39:07 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:39:07 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:39:07 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk"/>
Nov 14 14:39:07 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:39:07 user nova-compute[75292]:     </disk>
Nov 14 14:39:07 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:39:07 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:39:07 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:39:07 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:39:07 user nova-compute[75292]:       <serial>4512e466-37fd-4d88-9657-b502c397bd35</serial>
Nov 14 14:39:07 user nova-compute[75292]:     </disk>
Nov 14 14:39:07 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:39:07 user nova-compute[75292]:       <mac address="fa:16:3e:73:d7:5d"/>
Nov 14 14:39:07 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:39:07 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:39:07 user nova-compute[75292]:       <target dev="tap681ed373-e7"/>
Nov 14 14:39:07 user nova-compute[75292]:     </interface>
Nov 14 14:39:07 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:39:07 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/console.log" append="off"/>
Nov 14 14:39:07 user nova-compute[75292]:     </serial>
Nov 14 14:39:07 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:39:07 user nova-compute[75292]:     <video>
Nov 14 14:39:07 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:39:07 user nova-compute[75292]:     </video>
Nov 14 14:39:07 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:39:07 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:39:07 user nova-compute[75292]:     </rng>
Nov 14 14:39:07 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:39:07 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:39:07 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:39:07 user nova-compute[75292]:     </memballoon>
Nov 14 14:39:07 user nova-compute[75292]:   </devices>
Nov 14 14:39:07 user nova-compute[75292]: </domain>
Nov 14 14:39:07 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4465f52d-0426-410c-96ba-e9bb5c93c617]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f9440f1-1d40-52fc-b258-491074a03491', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542cf130>, {}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Disconnecting from: [] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.110s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== disconnect_volume: return (1378ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:39:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Deleting instance files /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062_del
Nov 14 14:39:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Deletion of /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062_del complete
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d00af4aa-2712-48c7-b5ff-9e4c062a6a0d req-1d9e2369-f2fe-4a23-9308-2b200b91b13a service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-vif-deleted-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap681ed373-e7, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap681ed373-e7, col_values=(('qos', UUID('5f2204f6-495c-4f02-861f-d18be27d29fd')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap681ed373-e7, col_values=(('external_ids', {'iface-id': '681ed373-e78f-4440-9658-ae5f20726f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:d7:5d', 'vm-uuid': 'c5ce2080-b527-4c87-b422-6de3f2d0c4d7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:07 user nova-compute[75292]: INFO os_vif [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7')
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-296d2d1a-c0ef-4fc3-9b79-36d15a9deaa0 req-96503f32-642a-4953-9d69-d7849895271b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received event network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-296d2d1a-c0ef-4fc3-9b79-36d15a9deaa0 req-96503f32-642a-4953-9d69-d7849895271b service nova] Acquiring lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-296d2d1a-c0ef-4fc3-9b79-36d15a9deaa0 req-96503f32-642a-4953-9d69-d7849895271b service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-296d2d1a-c0ef-4fc3-9b79-36d15a9deaa0 req-96503f32-642a-4953-9d69-d7849895271b service nova] Lock "44726e61-672d-42a1-81ae-489cb41dc49e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-296d2d1a-c0ef-4fc3-9b79-36d15a9deaa0 req-96503f32-642a-4953-9d69-d7849895271b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] No waiting events found dispatching network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:07 user nova-compute[75292]: WARNING nova.compute.manager [req-296d2d1a-c0ef-4fc3-9b79-36d15a9deaa0 req-96503f32-642a-4953-9d69-d7849895271b service nova] [instance: 44726e61-672d-42a1-81ae-489cb41dc49e] Received unexpected event network-vif-plugged-0113c6de-745c-4af7-8e3d-43ac3f4cba4e for instance with vm_state deleted and task_state None.
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:39:07 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:39:07 user nova-compute[75292]: INFO nova.virt.block_device [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Booting with volume 5050e2c4-4afb-4656-a981-27b11bd94664 at /dev/vdb
Nov 14 14:39:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Deleted allocations for instance 44726e61-672d-42a1-81ae-489cb41dc49e
Nov 14 14:39:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b4096c-c04e-467c-a72b-b0a718c1349a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[349c22f7-9cb5-4dd0-ad64-a8abc9d765d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f616d335-cf99-4da9-8238-ef307044349c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0b50dd-ea47-4e3e-83ce-bf9e58f2bac5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f3315300-9b40-4367-8c21-cdbd1f773f6b tempest-VolumesAdminNegativeTest-1045564970 tempest-VolumesAdminNegativeTest-1045564970-project-member] Lock "44726e61-672d-42a1-81ae-489cb41dc49e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.746s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:39:08 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[325564eb-6227-4c95-9d83-f926d9c8b7ed]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating existing volume attachment record: 9b5f36d4-5a21-4849-9fdf-ee9f17ec4230 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:08 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid 'e153ead2-1bf6-410b-9b0a-3c1bef1f8062' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid 'e153ead2-1bf6-410b-9b0a-3c1bef1f8062' (instance-00000010)
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Snapshot image upload complete
Nov 14 14:39:09 user nova-compute[75292]: INFO nova.compute.manager [None req-f168da37-494f-485b-96dd-2326b5c70f64 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Took 6.59 seconds to snapshot the instance on the hypervisor.
Nov 14 14:39:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:09 user nova-compute[75292]: WARNING nova.compute.manager [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state resized and task_state resize_reverting.
Nov 14 14:39:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:09 user nova-compute[75292]: WARNING nova.compute.manager [req-c7fc7699-be29-43bc-8dcc-129564a2d58b req-2969674e-81a1-4aa8-a433-f5cb053f7222 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state resized and task_state resize_reverting.
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:39:11 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance running successfully.
Nov 14 14:39:11 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:39:11 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=25.382266998291016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] finish_revert_migration finished successfully. {{(pid=75292) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 14:39:11 user nova-compute[75292]: INFO nova.compute.manager [None req-00864756-9ceb-414c-95cf-e693a4823ef9 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance to original state: 'active'
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 27d6dec7-0948-4b9c-9325-50e8212b5fb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 14:39:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:39:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Creating image(s)
Nov 14 14:39:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk 1073741824" returned: 0 in 0.049s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Cannot resize image /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Ensure instance console log exists: /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Start _get_guest_xml network_info=[{"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9b5f36d4-5a21-4849-9fdf-ee9f17ec4230', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e153ead2-1bf6-410b-9b0a-3c1bef1f8062', 'attached_at': '', 'detached_at': '', 'volume_id': '5050e2c4-4afb-4656-a981-27b11bd94664', 'serial': '5050e2c4-4afb-4656-a981-27b11bd94664'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:39:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 14:39:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'vcpu_model' on Instance uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:39:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:39:13 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef3ac02-1c23-40f9-b4de-9b5e44714ede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:39:13 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[761b1e8b-877c-4c84-8d0b-1b56d1e05a10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664] added
Nov 14 14:39:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4defb3-4455-4526-b49a-389e1f642acb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b008c97c-825a-412a-9f2e-6e96b741404c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUWrVhot {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUWrVhot" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[63505879-2b8c-448a-ab26-91565cbdc4cc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUWrVhot'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c34687-d057-4191-901e-59d94991a66a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b105842-4df2-482d-8886-59948bc7169f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:39:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a715da34-99a6-4e5d-8c16-3b1986c5c8a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]
Nov 14 14:39:14 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.
Nov 14 14:39:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dbd281-b6fb-45ec-ac32-711e02b27810]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7e7409-ffc0-4e9e-8240-a243626d97e8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:14 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:39:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:39:14 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:39:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251f4cd-401b-4291-a60a-949dd1b6df6c]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:39:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23135653835376263', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135653835376263', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-935294165',display_name='tempest-ServerActionsTestOtherA-server-1304088302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-935294165',id=16,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4PSWGM/1ftzwfDAUuYKxU/kl/E9ddsjcDHS5qvs1EZt9ShsPr19Pfa5LyW4urTLQ7G5FMF4MozVRL9Ox3bsqMTLxcdONv1cFJ8IQVNm7DDDavOofdZzJVSCkLE5kGTiQ==',key_name='tempest-keypair-1422090515',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-rfdcmkpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=e153ead2-1bf6-410b-9b0a-3c1bef1f8062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:39:15 user nova-compute[75292]:   <uuid>e153ead2-1bf6-410b-9b0a-3c1bef1f8062</uuid>
Nov 14 14:39:15 user nova-compute[75292]:   <name>instance-00000010</name>
Nov 14 14:39:15 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:39:15 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:39:15 user nova-compute[75292]:   <metadata>
Nov 14 14:39:15 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:39:15 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:39:15 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherA-server-1304088302</nova:name>
Nov 14 14:39:15 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:39:13</nova:creationTime>
Nov 14 14:39:15 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:39:15 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:39:15 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:39:15 user nova-compute[75292]:       <nova:owner>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:user uuid="e75042706a2347ebba11d20ba65ba282">tempest-ServerActionsTestOtherA-1545988335-project-member</nova:user>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:project uuid="54b7e88c2e88460484f06a772b1f60c3">tempest-ServerActionsTestOtherA-1545988335</nova:project>
Nov 14 14:39:15 user nova-compute[75292]:       </nova:owner>
Nov 14 14:39:15 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:39:15 user nova-compute[75292]:       <nova:ports>
Nov 14 14:39:15 user nova-compute[75292]:         <nova:port uuid="c3d85393-dc7a-40ef-84a8-0e7b69e8aaae">
Nov 14 14:39:15 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:39:15 user nova-compute[75292]:         </nova:port>
Nov 14 14:39:15 user nova-compute[75292]:       </nova:ports>
Nov 14 14:39:15 user nova-compute[75292]:     </nova:instance>
Nov 14 14:39:15 user nova-compute[75292]:   </metadata>
Nov 14 14:39:15 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:39:15 user nova-compute[75292]:     <system>
Nov 14 14:39:15 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:39:15 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:39:15 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:39:15 user nova-compute[75292]:       <entry name="serial">e153ead2-1bf6-410b-9b0a-3c1bef1f8062</entry>
Nov 14 14:39:15 user nova-compute[75292]:       <entry name="uuid">e153ead2-1bf6-410b-9b0a-3c1bef1f8062</entry>
Nov 14 14:39:15 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:39:15 user nova-compute[75292]:     </system>
Nov 14 14:39:15 user nova-compute[75292]:   </sysinfo>
Nov 14 14:39:15 user nova-compute[75292]:   <os>
Nov 14 14:39:15 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:39:15 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:39:15 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:39:15 user nova-compute[75292]:   </os>
Nov 14 14:39:15 user nova-compute[75292]:   <features>
Nov 14 14:39:15 user nova-compute[75292]:     <acpi/>
Nov 14 14:39:15 user nova-compute[75292]:     <apic/>
Nov 14 14:39:15 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:39:15 user nova-compute[75292]:   </features>
Nov 14 14:39:15 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:39:15 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:39:15 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:39:15 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:39:15 user nova-compute[75292]:   </clock>
Nov 14 14:39:15 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:39:15 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:39:15 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:39:15 user nova-compute[75292]:   </cpu>
Nov 14 14:39:15 user nova-compute[75292]:   <devices>
Nov 14 14:39:15 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:39:15 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:39:15 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk"/>
Nov 14 14:39:15 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:39:15 user nova-compute[75292]:     </disk>
Nov 14 14:39:15 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:39:15 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:39:15 user nova-compute[75292]:       <source dev="/dev/sdc"/>
Nov 14 14:39:15 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:39:15 user nova-compute[75292]:       <serial>5050e2c4-4afb-4656-a981-27b11bd94664</serial>
Nov 14 14:39:15 user nova-compute[75292]:     </disk>
Nov 14 14:39:15 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:39:15 user nova-compute[75292]:       <mac address="fa:16:3e:cd:43:9e"/>
Nov 14 14:39:15 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:39:15 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:39:15 user nova-compute[75292]:       <target dev="tapc3d85393-dc"/>
Nov 14 14:39:15 user nova-compute[75292]:     </interface>
Nov 14 14:39:15 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:39:15 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/console.log" append="off"/>
Nov 14 14:39:15 user nova-compute[75292]:     </serial>
Nov 14 14:39:15 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:39:15 user nova-compute[75292]:     <video>
Nov 14 14:39:15 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:39:15 user nova-compute[75292]:     </video>
Nov 14 14:39:15 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:39:15 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:39:15 user nova-compute[75292]:     </rng>
Nov 14 14:39:15 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:39:15 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:39:15 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:39:15 user nova-compute[75292]:     </memballoon>
Nov 14 14:39:15 user nova-compute[75292]:   </devices>
Nov 14 14:39:15 user nova-compute[75292]: </domain>
Nov 14 14:39:15 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-935294165',display_name='tempest-ServerActionsTestOtherA-server-1304088302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-935294165',id=16,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4PSWGM/1ftzwfDAUuYKxU/kl/E9ddsjcDHS5qvs1EZt9ShsPr19Pfa5LyW4urTLQ7G5FMF4MozVRL9Ox3bsqMTLxcdONv1cFJ8IQVNm7DDDavOofdZzJVSCkLE5kGTiQ==',key_name='tempest-keypair-1422090515',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-rfdcmkpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=e153ead2-1bf6-410b-9b0a-3c1bef1f8062,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG os_vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362f4694-2f3a-508b-9979-9c99f6ac0e91', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d85393-dc, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d85393-dc, col_values=(('qos', UUID('227c7fe2-aa5c-4364-96e3-a92032e8002d')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d85393-dc, col_values=(('external_ids', {'iface-id': 'c3d85393-dc7a-40ef-84a8-0e7b69e8aaae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:43:9e', 'vm-uuid': 'e153ead2-1bf6-410b-9b0a-3c1bef1f8062'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:15 user nova-compute[75292]: INFO os_vif [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc')
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No VIF found with MAC fa:16:3e:cd:43:9e, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:39:15 user nova-compute[75292]: INFO nova.compute.claims [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Claim successful on node user
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:39:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:39:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.policy [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '533cc5752e5b4fe2b9b2f2b91bd4259a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444dc84dbece41c6b22a37008eeb40e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:39:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Creating image(s)
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "/opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "/opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "/opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.212s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk 1073741824" returned: 0 in 0.058s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Successfully created port: 46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-ac2275cf-01ff-4928-9ee1-83db975fbf5b req-cf4991ef-714b-4d74-a9c2-6782117d94c1 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ac2275cf-01ff-4928-9ee1-83db975fbf5b req-cf4991ef-714b-4d74-a9c2-6782117d94c1 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ac2275cf-01ff-4928-9ee1-83db975fbf5b req-cf4991ef-714b-4d74-a9c2-6782117d94c1 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ac2275cf-01ff-4928-9ee1-83db975fbf5b req-cf4991ef-714b-4d74-a9c2-6782117d94c1 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-ac2275cf-01ff-4928-9ee1-83db975fbf5b req-cf4991ef-714b-4d74-a9c2-6782117d94c1 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:16 user nova-compute[75292]: WARNING nova.compute.manager [req-ac2275cf-01ff-4928-9ee1-83db975fbf5b req-cf4991ef-714b-4d74-a9c2-6782117d94c1 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state active and task_state rebuild_spawning.
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.193s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:39:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Cannot resize image /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Ensure instance console log exists: /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Successfully updated port: 46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "refresh_cache-c483fca4-a13e-4a9c-957f-fe36ab5e3db7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquired lock "refresh_cache-c483fca4-a13e-4a9c-957f-fe36ab5e3db7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Updating instance_info_cache with network_info: [{"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Releasing lock "refresh_cache-c483fca4-a13e-4a9c-957f-fe36ab5e3db7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Instance network_info: |[{"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Start _get_guest_xml network_info=[{"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:39:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:39:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2052084391',display_name='tempest-ServersNegativeTestJSON-server-2052084391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2052084391',id=22,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444dc84dbece41c6b22a37008eeb40e6',ramdisk_id='',reservation_id='r-cuxu50la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1575597503',owner_user_name='tempest-ServersNegativeTestJSON-1575597503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:39:16Z,user_data=None,user_id='533cc5752e5b4fe2b9b2f2b91bd4259a',uuid=c483fca4-a13e-4a9c-957f-fe36ab5e3db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converting VIF {"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.objects.instance [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lazy-loading 'pci_devices' on Instance uuid c483fca4-a13e-4a9c-957f-fe36ab5e3db7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:39:17 user nova-compute[75292]:   <uuid>c483fca4-a13e-4a9c-957f-fe36ab5e3db7</uuid>
Nov 14 14:39:17 user nova-compute[75292]:   <name>instance-00000016</name>
Nov 14 14:39:17 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:39:17 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:39:17 user nova-compute[75292]:   <metadata>
Nov 14 14:39:17 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:39:17 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:39:17 user nova-compute[75292]:       <nova:name>tempest-ServersNegativeTestJSON-server-2052084391</nova:name>
Nov 14 14:39:17 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:39:17</nova:creationTime>
Nov 14 14:39:17 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:39:17 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:39:17 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:39:17 user nova-compute[75292]:       <nova:owner>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:user uuid="533cc5752e5b4fe2b9b2f2b91bd4259a">tempest-ServersNegativeTestJSON-1575597503-project-member</nova:user>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:project uuid="444dc84dbece41c6b22a37008eeb40e6">tempest-ServersNegativeTestJSON-1575597503</nova:project>
Nov 14 14:39:17 user nova-compute[75292]:       </nova:owner>
Nov 14 14:39:17 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:39:17 user nova-compute[75292]:       <nova:ports>
Nov 14 14:39:17 user nova-compute[75292]:         <nova:port uuid="46a5a891-460f-4047-b85d-38ff7df38097">
Nov 14 14:39:17 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 14:39:17 user nova-compute[75292]:         </nova:port>
Nov 14 14:39:17 user nova-compute[75292]:       </nova:ports>
Nov 14 14:39:17 user nova-compute[75292]:     </nova:instance>
Nov 14 14:39:17 user nova-compute[75292]:   </metadata>
Nov 14 14:39:17 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:39:17 user nova-compute[75292]:     <system>
Nov 14 14:39:17 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:39:17 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:39:17 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:39:17 user nova-compute[75292]:       <entry name="serial">c483fca4-a13e-4a9c-957f-fe36ab5e3db7</entry>
Nov 14 14:39:17 user nova-compute[75292]:       <entry name="uuid">c483fca4-a13e-4a9c-957f-fe36ab5e3db7</entry>
Nov 14 14:39:17 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:39:17 user nova-compute[75292]:     </system>
Nov 14 14:39:17 user nova-compute[75292]:   </sysinfo>
Nov 14 14:39:17 user nova-compute[75292]:   <os>
Nov 14 14:39:17 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:39:17 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:39:17 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:39:17 user nova-compute[75292]:   </os>
Nov 14 14:39:17 user nova-compute[75292]:   <features>
Nov 14 14:39:17 user nova-compute[75292]:     <acpi/>
Nov 14 14:39:17 user nova-compute[75292]:     <apic/>
Nov 14 14:39:17 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:39:17 user nova-compute[75292]:   </features>
Nov 14 14:39:17 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:39:17 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:39:17 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:39:17 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:39:17 user nova-compute[75292]:   </clock>
Nov 14 14:39:17 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:39:17 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:39:17 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:39:17 user nova-compute[75292]:   </cpu>
Nov 14 14:39:17 user nova-compute[75292]:   <devices>
Nov 14 14:39:17 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:39:17 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:39:17 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk"/>
Nov 14 14:39:17 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:39:17 user nova-compute[75292]:     </disk>
Nov 14 14:39:17 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:39:17 user nova-compute[75292]:       <mac address="fa:16:3e:e3:23:41"/>
Nov 14 14:39:17 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:39:17 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:39:17 user nova-compute[75292]:       <target dev="tap46a5a891-46"/>
Nov 14 14:39:17 user nova-compute[75292]:     </interface>
Nov 14 14:39:17 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:39:17 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/console.log" append="off"/>
Nov 14 14:39:17 user nova-compute[75292]:     </serial>
Nov 14 14:39:17 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:39:17 user nova-compute[75292]:     <video>
Nov 14 14:39:17 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:39:17 user nova-compute[75292]:     </video>
Nov 14 14:39:17 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:39:17 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:39:17 user nova-compute[75292]:     </rng>
Nov 14 14:39:17 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:39:17 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:39:17 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:39:17 user nova-compute[75292]:     </memballoon>
Nov 14 14:39:17 user nova-compute[75292]:   </devices>
Nov 14 14:39:17 user nova-compute[75292]: </domain>
Nov 14 14:39:17 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2052084391',display_name='tempest-ServersNegativeTestJSON-server-2052084391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2052084391',id=22,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444dc84dbece41c6b22a37008eeb40e6',ramdisk_id='',reservation_id='r-cuxu50la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1575597503',owner_user_name='tempest-ServersNegativeTestJSON-1575597503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:39:16Z,user_data=None,user_id='533cc5752e5b4fe2b9b2f2b91bd4259a',uuid=c483fca4-a13e-4a9c-957f-fe36ab5e3db7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converting VIF {"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG os_vif [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02ccae67-300d-5326-8729-0ca4663f6108', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46a5a891-46, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46a5a891-46, col_values=(('qos', UUID('dba48d92-b48b-4cbd-9294-b23ee5e5d10c')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46a5a891-46, col_values=(('external_ids', {'iface-id': '46a5a891-460f-4047-b85d-38ff7df38097', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:23:41', 'vm-uuid': 'c483fca4-a13e-4a9c-957f-fe36ab5e3db7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:18 user nova-compute[75292]: INFO os_vif [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46')
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] No VIF found with MAC fa:16:3e:e3:23:41, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:39:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance spawned successfully.
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75292) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:18 user nova-compute[75292]: WARNING nova.compute.manager [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state active and task_state None.
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received event network-changed-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Refreshing instance network info cache due to event network-changed-46a5a891-460f-4047-b85d-38ff7df38097. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] Acquiring lock "refresh_cache-c483fca4-a13e-4a9c-957f-fe36ab5e3db7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] Acquired lock "refresh_cache-c483fca4-a13e-4a9c-957f-fe36ab5e3db7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Refreshing network info cache for port 46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:39:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4305d233-79b7-43bf-81e8-fb6f77914b07 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Updated VIF entry in instance network info cache for port 46a5a891-460f-4047-b85d-38ff7df38097. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Updating instance_info_cache with network_info: [{"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cf8fe607-29c6-475e-936b-6fe05375ec31 req-5738bd13-e3a4-450e-8097-f903acc49a81 service nova] Releasing lock "refresh_cache-c483fca4-a13e-4a9c-957f-fe36ab5e3db7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb58d7dd-d5fb-4834-8f5d-a77c30b39816 req-d098e827-019d-4018-8cc4-4a9bc09db73b service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received event network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb58d7dd-d5fb-4834-8f5d-a77c30b39816 req-d098e827-019d-4018-8cc4-4a9bc09db73b service nova] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb58d7dd-d5fb-4834-8f5d-a77c30b39816 req-d098e827-019d-4018-8cc4-4a9bc09db73b service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb58d7dd-d5fb-4834-8f5d-a77c30b39816 req-d098e827-019d-4018-8cc4-4a9bc09db73b service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb58d7dd-d5fb-4834-8f5d-a77c30b39816 req-d098e827-019d-4018-8cc4-4a9bc09db73b service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] No waiting events found dispatching network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:19 user nova-compute[75292]: WARNING nova.compute.manager [req-fb58d7dd-d5fb-4834-8f5d-a77c30b39816 req-d098e827-019d-4018-8cc4-4a9bc09db73b service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received unexpected event network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 for instance with vm_state building and task_state spawning.
Nov 14 14:39:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:39:21 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Instance spawned successfully.
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:39:21 user nova-compute[75292]: INFO nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-44766223-0449-4b8a-ad2e-d82087333748 req-215ac004-700f-46c5-8b05-19798a0ab98d service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received event network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-44766223-0449-4b8a-ad2e-d82087333748 req-215ac004-700f-46c5-8b05-19798a0ab98d service nova] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-44766223-0449-4b8a-ad2e-d82087333748 req-215ac004-700f-46c5-8b05-19798a0ab98d service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-44766223-0449-4b8a-ad2e-d82087333748 req-215ac004-700f-46c5-8b05-19798a0ab98d service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-44766223-0449-4b8a-ad2e-d82087333748 req-215ac004-700f-46c5-8b05-19798a0ab98d service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] No waiting events found dispatching network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:21 user nova-compute[75292]: WARNING nova.compute.manager [req-44766223-0449-4b8a-ad2e-d82087333748 req-215ac004-700f-46c5-8b05-19798a0ab98d service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received unexpected event network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 for instance with vm_state building and task_state spawning.
Nov 14 14:39:21 user nova-compute[75292]: INFO nova.compute.manager [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Took 6.22 seconds to build instance.
Nov 14 14:39:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fc2fdd6c-6827-4131-bfd3-e6c82877c8de tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.328s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid c75f05cb-4b25-4c55-81f6-4853a6ee4938 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid c5a143c2-8994-4297-91b2-b64ffa4e77f7 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 27d6dec7-0948-4b9c-9325-50e8212b5fb9 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid c483fca4-a13e-4a9c-957f-fe36ab5e3db7 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "48cc4550-2634-4291-a55b-e66338585160" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:25 user nova-compute[75292]: WARNING oslo_messaging._drivers.amqpdriver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "48cc4550-2634-4291-a55b-e66338585160" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:45 user nova-compute[75292]: INFO nova.compute.manager [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Unrescuing
Nov 14 14:39:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'flavor' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-4356b2b0-bbc8-4ce9-9a52-de62bc7d9c43 req-9d7b119c-47e6-4fa3-80fa-48d75987cb8e service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4356b2b0-bbc8-4ce9-9a52-de62bc7d9c43 req-9d7b119c-47e6-4fa3-80fa-48d75987cb8e service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4356b2b0-bbc8-4ce9-9a52-de62bc7d9c43 req-9d7b119c-47e6-4fa3-80fa-48d75987cb8e service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4356b2b0-bbc8-4ce9-9a52-de62bc7d9c43 req-9d7b119c-47e6-4fa3-80fa-48d75987cb8e service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-4356b2b0-bbc8-4ce9-9a52-de62bc7d9c43 req-9d7b119c-47e6-4fa3-80fa-48d75987cb8e service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:45 user nova-compute[75292]: WARNING nova.compute.manager [req-4356b2b0-bbc8-4ce9-9a52-de62bc7d9c43 req-9d7b119c-47e6-4fa3-80fa-48d75987cb8e service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:39:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance destroyed successfully.
Nov 14 14:39:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-1fbd307b-c810-464c-8022-53c70240ef09 req-bf4fc477-ba52-4554-9ed2-cbdacbcbe047 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1fbd307b-c810-464c-8022-53c70240ef09 req-bf4fc477-ba52-4554-9ed2-cbdacbcbe047 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1fbd307b-c810-464c-8022-53c70240ef09 req-bf4fc477-ba52-4554-9ed2-cbdacbcbe047 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1fbd307b-c810-464c-8022-53c70240ef09 req-bf4fc477-ba52-4554-9ed2-cbdacbcbe047 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-1fbd307b-c810-464c-8022-53c70240ef09 req-bf4fc477-ba52-4554-9ed2-cbdacbcbe047 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:47 user nova-compute[75292]: WARNING nova.compute.manager [req-1fbd307b-c810-464c-8022-53c70240ef09 req-bf4fc477-ba52-4554-9ed2-cbdacbcbe047 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:50 user nova-compute[75292]: WARNING nova.compute.manager [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:39:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:39:50 user nova-compute[75292]: WARNING nova.compute.manager [req-26e5b479-9ec8-49cc-8890-526c1be01c9f req-3a0b6ef7-bf2b-4121-ac24-c0aa30eb3dc8 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:39:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-011bf701-9a7e-438e-b2bb-8f4b049dcc09 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:39:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG nova.objects.instance [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lazy-loading 'flavor' on Instance uuid 27d6dec7-0948-4b9c-9325-50e8212b5fb9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:39:58 user nova-compute[75292]: INFO nova.compute.manager [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Attaching volume f4266b3d-fe04-4019-b784-9120b86f1e52 to /dev/vdb
Nov 14 14:39:58 user nova-compute[75292]: DEBUG os_brick.utils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:39:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e2c492-d69e-4841-9920-50ab61f8bf40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc657e-fd1d-4d21-a8b4-a709181b858b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a5845-4595-4b5c-9c75-9d1e671bfac7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fa7ea3-cde4-43f5-8b77-1f5311d99df1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:39:59 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:39:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124795d-6129-44bb-9030-b0e600210755]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG os_brick.utils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Updating existing volume attachment record: c93be9d9-04d3-4b4c-bbdf-72d2ff6749a3 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:39:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'flavor' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:01 user nova-compute[75292]: INFO nova.compute.manager [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Attaching volume 50f9263a-8520-4dc4-8601-b7b181497488 to /dev/vdb
Nov 14 14:40:01 user nova-compute[75292]: DEBUG os_brick.utils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d0ec7-73f6-448d-adbb-599f705af742]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d94bc-5bff-47bf-b953-16360efb0d06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[861c297f-416d-4d29-b5e7-c6a07fbb26f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b501751d-08c7-4fba-9bd4-c99da84bcdb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:40:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:40:02 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:40:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ec634-a667-4c9e-9694-5634ba2ca4c5]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG os_brick.utils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating existing volume attachment record: ebf5cc7d-7acb-458e-b787-cc9c5c147297 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:40:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvNzrXfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:03 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:03 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:03 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f065c-3447-49f2-b9b1-f971f2c51bc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:40:03 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e85d54-7cbb-44f4-bb29-fa657bb8d1b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52] added
Nov 14 14:40:03 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a069d5-9c25-4c2d-9108-577f9919c011]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ef0c10-518a-429e-868e-7e3531a89c02]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvNzrXfc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvNzrXfc" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d90549-862f-4460-9fcb-acb273f1dc41]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvNzrXfc'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d9ab1-d332-4831-8195-7f156d882ccc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbf9769-36eb-4315-96ea-a8ea21b599e0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50b18fa-42b6-4b70-b4da-de1170e55904]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260]
Nov 14 14:40:04 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[115b882d-e8da-4f53-80d0-6923c74e9600]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[33259561-ab03-4442-a10a-aaa56d98ff89]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a33eb5a-7e15-4d92-abcc-b76e15a38d3d]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:40:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-changed-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Refreshing instance network info cache due to event network-changed-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] Acquiring lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] Acquired lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Refreshing network info cache for port a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvNzrXfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26662613565643031', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662613565643031', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.objects.instance [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lazy-loading 'flavor' on Instance uuid 27d6dec7-0948-4b9c-9325-50e8212b5fb9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:40:05 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:40:05 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:40:05 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:40:05 user nova-compute[75292]:   <serial>f4266b3d-fe04-4019-b784-9120b86f1e52</serial>
Nov 14 14:40:05 user nova-compute[75292]: </disk>
Nov 14 14:40:05 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "interface-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "interface-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'flavor' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updated VIF entry in instance network info cache for port a34295b5-1ac7-44b4-b7a6-1a0a12232f5c. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] No VIF found with MAC fa:16:3e:58:4d:4f, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dfdad2ec-5802-4bd1-98fb-b6e4b4ceacf4 req-705a07ae-c40f-46b6-b6de-d4810855f7ee service nova] Releasing lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'pci_requests' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.objects.base [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Object Instance<6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438> lazy-loaded attributes: flavor,pci_requests {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-768686f1-13f4-4fe7-ace6-808c86ec5b51 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.092s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:05 user nova-compute[75292]: DEBUG nova.policy [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f9145d6e9f947d78220d587fe76fa99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed7f4b849d66445b847310e31ebb139e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Successfully created port: 922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:06 user nova-compute[75292]: INFO nova.compute.manager [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Terminating instance
Nov 14 14:40:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:40:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-7f83957a-f110-4ab5-9ca7-cf0269af5cb3 req-ccb90706-422f-4f82-8fba-93bf4f9c0045 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-vif-unplugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7f83957a-f110-4ab5-9ca7-cf0269af5cb3 req-ccb90706-422f-4f82-8fba-93bf4f9c0045 service nova] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7f83957a-f110-4ab5-9ca7-cf0269af5cb3 req-ccb90706-422f-4f82-8fba-93bf4f9c0045 service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7f83957a-f110-4ab5-9ca7-cf0269af5cb3 req-ccb90706-422f-4f82-8fba-93bf4f9c0045 service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-7f83957a-f110-4ab5-9ca7-cf0269af5cb3 req-ccb90706-422f-4f82-8fba-93bf4f9c0045 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] No waiting events found dispatching network-vif-unplugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-7f83957a-f110-4ab5-9ca7-cf0269af5cb3 req-ccb90706-422f-4f82-8fba-93bf4f9c0045 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-vif-unplugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:07 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:07 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:07 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb3ba9-35d1-4017-bdac-42a566a3dd75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:40:07 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435b458-222a-4d65-90b3-3eddd3165d13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488] added
Nov 14 14:40:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7a40f-781a-458d-92c5-d85c4ed4cc62]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59470e0a-8192-44e9-9e75-e11302b0d270]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSAyUDgC {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSAyUDgC" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c09775f-0c57-4976-8fe6-759484354299]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSAyUDgC'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fc8ced-a975-4619-a3e3-574a5553e974]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab7993-5d08-4af0-b372-94d3474c7e23]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Instance destroyed successfully.
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lazy-loading 'resources' on Instance uuid 27d6dec7-0948-4b9c-9325-50e8212b5fb9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Successfully updated port: 922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766c2d3-b396-4383-b142-2f1bb49c0da9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]
Nov 14 14:40:07 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquired lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-706148200',display_name='tempest-DeleteServersTestJSON-server-706148200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-706148200',id=19,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='554d69574dda4f5d912b17e57a98f116',ramdisk_id='',reservation_id='r-o0py11er',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-414981124',owner_user_name='tempest-DeleteServersTestJSON-414981124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:14Z,user_data=None,user_id='9563ec83e8234bd4b057bf302223bacf',uuid=27d6dec7-0948-4b9c-9325-50e8212b5fb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Converting VIF {"id": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "address": "fa:16:3e:58:4d:4f", "network": {"id": "4c26f58e-7a90-4e28-8f50-2543d97f760c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2092066398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "554d69574dda4f5d912b17e57a98f116", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6ff3be2-bd", "ovs_interfaceid": "e6ff3be2-bd97-42d0-8946-fa6bd520f0e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_vif [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d95893-c824-417d-bbb9-2056faa47b3f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6ff3be2-bd, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d714d17f-ee11-494b-984f-ab008a2d7412) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:07 user nova-compute[75292]: INFO os_vif [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4d:4f,bridge_name='br-int',has_traffic_filtering=True,id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8,network=Network(4c26f58e-7a90-4e28-8f50-2543d97f760c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6ff3be2-bd')
Nov 14 14:40:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvNzrXfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:07 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5fca85-57e4-42e0-a601-77ac812db102]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:07 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b8e2c-77be-4caa-aca5-c08df63f9afb]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Releasing lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_vif [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6035cd84-8c27-5d77-a9e9-3c4f54611433', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26133633065393961', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133633065393961', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.063s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap922cd2ab-27, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap922cd2ab-27, col_values=(('qos', UUID('613e8124-58b5-4c6e-9f9a-f4394b87b89c')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap922cd2ab-27, col_values=(('external_ids', {'iface-id': '922cd2ab-2796-4f91-bcd7-60bda85d4847', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:ca:90', 'vm-uuid': '6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'flavor' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afef0b6-63c1-4264-aad2-066700447fe6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:40:08 user nova-compute[75292]: No targets found.
Nov 14 14:40:08 user nova-compute[75292]: iSNS:
Nov 14 14:40:08 user nova-compute[75292]: No targets found.
Nov 14 14:40:08 user nova-compute[75292]: STATIC:
Nov 14 14:40:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:40:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52
Nov 14 14:40:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:40:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:40:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:08 user nova-compute[75292]: FIRMWARE:
Nov 14 14:40:08 user nova-compute[75292]: No targets found.
Nov 14 14:40:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:40:08 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:40:08 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: INFO os_vif [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27')
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] attach device xml: <interface type="ethernet">
Nov 14 14:40:08 user nova-compute[75292]:   <mac address="fa:16:3e:d7:ca:90"/>
Nov 14 14:40:08 user nova-compute[75292]:   <model type="virtio"/>
Nov 14 14:40:08 user nova-compute[75292]:   <mtu size="1442"/>
Nov 14 14:40:08 user nova-compute[75292]:   <target dev="tap922cd2ab-27"/>
Nov 14 14:40:08 user nova-compute[75292]: </interface>
Nov 14 14:40:08 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce416090-0b23-490b-b9ed-7b7dc7d60d59]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c644ab-00c5-402c-95ce-c7cdb6fbce97]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5463e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52'): ({'sdd'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Removing single pathed devices sdd {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:40:08 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:40:08 user nova-compute[75292]:   <source dev="/dev/sde"/>
Nov 14 14:40:08 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:40:08 user nova-compute[75292]:   <serial>50f9263a-8520-4dc4-8601-b7b181497488</serial>
Nov 14 14:40:08 user nova-compute[75292]: </disk>
Nov 14 14:40:08 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9c167d-c439-485e-bd64-b5569c3df056]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f1ad00-ecce-4e28-bd16-cf21d5430174]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Flushing IO for device /dev/sdd {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab382f-2baf-4148-b5f8-bce1392d0f7b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:40:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.113s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0e6ca-339d-47a9-bf5b-b996225e8c61]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8874849-2795-4392-9a7d-24fce355a4d5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c801c1-5d2c-4388-8406-6f41a40dd5b6]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260]
Nov 14 14:40:09 user nova-compute[75292]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4266b3d-fe04-4019-b784-9120b86f1e52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fdc34-da81-4a3d-93ce-941b735ce3aa]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.489s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] <== disconnect_volume: return (1551ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:40:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Deleting instance files /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9_del
Nov 14 14:40:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Deletion of /opt/stack/data/nova/instances/27d6dec7-0948-4b9c-9325-50e8212b5fb9_del complete
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Acquiring lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] No waiting events found dispatching network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:09 user nova-compute[75292]: WARNING nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received unexpected event network-vif-plugged-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 for instance with vm_state active and task_state deleting.
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-changed-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Refreshing instance network info cache due to event network-changed-922cd2ab-2796-4f91-bcd7-60bda85d4847. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Acquiring lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Acquired lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Refreshing network info cache for port 922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No BDM found with device name hda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No VIF found with MAC fa:16:3e:0c:00:22, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:40:09 user nova-compute[75292]: INFO nova.compute.manager [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Took 2.56 seconds to destroy the instance on the hypervisor.
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:40:09 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:40:09 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:40:09 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:40:09</nova:creationTime>
Nov 14 14:40:09 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:40:09 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:40:09 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:40:09 user nova-compute[75292]:   <nova:owner>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:40:09 user nova-compute[75292]:   </nova:owner>
Nov 14 14:40:09 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:40:09 user nova-compute[75292]:   <nova:ports>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:40:09 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:40:09 user nova-compute[75292]:     </nova:port>
Nov 14 14:40:09 user nova-compute[75292]:     <nova:port uuid="922cd2ab-2796-4f91-bcd7-60bda85d4847">
Nov 14 14:40:09 user nova-compute[75292]:       <nova:ip type="fixed" address="10.10.10.100" ipVersion="4"/>
Nov 14 14:40:09 user nova-compute[75292]:     </nova:port>
Nov 14 14:40:09 user nova-compute[75292]:   </nova:ports>
Nov 14 14:40:09 user nova-compute[75292]: </nova:instance>
Nov 14 14:40:09 user nova-compute[75292]:  {{(pid=75292) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2ff74a6f-1332-46a3-860d-0005eba11532 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "interface-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.819s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No VIF found with MAC fa:16:3e:fe:e0:43, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6a156ac9-a3ae-4ebd-867f-845f80aad961 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.031s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updated VIF entry in instance network info cache for port 922cd2ab-2796-4f91-bcd7-60bda85d4847. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'flavor' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Releasing lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:09 user nova-compute[75292]: WARNING nova.compute.manager [req-8a9a41e1-d2a9-4fcb-bd31-772b22ca7c78 req-2e702ff3-9e3c-4cae-9fba-ce58348ee053 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 for instance with vm_state active and task_state None.
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:10 user nova-compute[75292]: INFO nova.compute.manager [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Attaching volume 53acb8af-84ea-4276-8700-b4deb2374287 to /dev/vdb
Nov 14 14:40:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-117aad86-5a33-4fd1-bafc-708656594a54 req-e1c097c5-bc49-451a-aa9b-704b61f7c0d7 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Received event network-vif-deleted-e6ff3be2-bd97-42d0-8946-fa6bd520f0e8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:10 user nova-compute[75292]: INFO nova.compute.manager [req-117aad86-5a33-4fd1-bafc-708656594a54 req-e1c097c5-bc49-451a-aa9b-704b61f7c0d7 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Neutron deleted interface e6ff3be2-bd97-42d0-8946-fa6bd520f0e8; detaching it from the instance and deleting it from the info cache
Nov 14 14:40:10 user nova-compute[75292]: DEBUG nova.network.neutron [req-117aad86-5a33-4fd1-bafc-708656594a54 req-e1c097c5-bc49-451a-aa9b-704b61f7c0d7 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG os_brick.utils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f474ff7-c398-4326-bd12-f38ed9834002]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-117aad86-5a33-4fd1-bafc-708656594a54 req-e1c097c5-bc49-451a-aa9b-704b61f7c0d7 service nova] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Detach interface failed, port_id=e6ff3be2-bd97-42d0-8946-fa6bd520f0e8, reason: Instance 27d6dec7-0948-4b9c-9325-50e8212b5fb9 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:40:10 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Took 1.07 seconds to deallocate network for instance.
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[184369e6-2bd0-4618-9e35-32e960a29114]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fdc4b3-cb1e-44f2-9ff3-912eb0612add]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d757b9c-1afa-4608-b5f8-abafd72b898b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:40:10 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e924c-bcb8-427f-ba07-aafda51c4c68]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG os_brick.utils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating existing volume attachment record: 0f002519-04cd-4f7f-b5f1-11aa4c5242bc {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:40:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:11 user nova-compute[75292]: INFO nova.compute.manager [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] [instance: 27d6dec7-0948-4b9c-9325-50e8212b5fb9] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-400c0fe3-8c02-467e-a0d0-b102dec43e4d req-e61fc250-15ec-432b-92a1-792242f4326f service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-400c0fe3-8c02-467e-a0d0-b102dec43e4d req-e61fc250-15ec-432b-92a1-792242f4326f service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-400c0fe3-8c02-467e-a0d0-b102dec43e4d req-e61fc250-15ec-432b-92a1-792242f4326f service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-400c0fe3-8c02-467e-a0d0-b102dec43e4d req-e61fc250-15ec-432b-92a1-792242f4326f service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-400c0fe3-8c02-467e-a0d0-b102dec43e4d req-e61fc250-15ec-432b-92a1-792242f4326f service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:11 user nova-compute[75292]: WARNING nova.compute.manager [req-400c0fe3-8c02-467e-a0d0-b102dec43e4d req-e61fc250-15ec-432b-92a1-792242f4326f service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 for instance with vm_state active and task_state None.
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:12 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Deleted allocations for instance 27d6dec7-0948-4b9c-9325-50e8212b5fb9
Nov 14 14:40:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1c769021-4bc7-4283-b8bc-18bea0a713d7 tempest-DeleteServersTestJSON-414981124 tempest-DeleteServersTestJSON-414981124-project-member] Lock "27d6dec7-0948-4b9c-9325-50e8212b5fb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.315s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:12 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid '27d6dec7-0948-4b9c-9325-50e8212b5fb9' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid '27d6dec7-0948-4b9c-9325-50e8212b5fb9' (instance-00000013)
Nov 14 14:40:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:40:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.340892791748047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c483fca4-a13e-4a9c-957f-fe36ab5e3db7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:40:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:40:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing instance network info cache due to event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMRBcaIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:15 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:15 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:15 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f4d22b-3e4e-4df2-8397-62213cbe689b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:40:15 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d907e0c8-9bc1-46b1-a440-ae61225f9f7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287] added
Nov 14 14:40:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06725d99-3a6b-40d3-8791-4f92ce4d2693]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.122s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60fb153-df67-4130-bc3e-57736c22d7e0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMRBcaIU {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMRBcaIU" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd187b38-b6bd-4a3f-91eb-a4d78919944d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMRBcaIU'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4bb665-017b-4ed5-afa6-1d8d9707414c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fad05a1-7a0e-4e67-958b-d66aae6670d1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c39b11b-423c-42f1-b018-cd1a2a320ec3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260]
Nov 14 14:40:15 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updated VIF entry in instance network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7165a6-d8fa-4451-a03e-4f3820d05203]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a75dd95-289b-42ac-bf5e-a9773d8ac3c2 req-c54c40b2-dc90-4157-9e57-a3e36e1c9303 service nova] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a28186-bbfd-4450-98f6-085434530b96]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.436s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.057s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b761b3e5-58ff-4074-86f6-250408812353]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMRBcaIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] <== connect_volume: return (1510ms) {'type': 'block', 'scsi_wwn': '23736376339356631', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736376339356631', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'flavor' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:40:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:40:16 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:40:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:40:16 user nova-compute[75292]:   <serial>53acb8af-84ea-4276-8700-b4deb2374287</serial>
Nov 14 14:40:16 user nova-compute[75292]: </disk>
Nov 14 14:40:16 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:40:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No BDM found with device name hda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] No VIF found with MAC fa:16:3e:0c:00:22, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:40:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-041be93f-fb58-48ae-90ff-68909d7dd7fc tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.329s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing instance network info cache due to event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:40:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:40:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:19 user nova-compute[75292]: INFO nova.compute.manager [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Detaching volume 53acb8af-84ea-4276-8700-b4deb2374287
Nov 14 14:40:19 user nova-compute[75292]: INFO nova.virt.block_device [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Attempting to driver detach volume 53acb8af-84ea-4276-8700-b4deb2374287 from mountpoint /dev/vdb
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Attempting to detach device vdb from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:40:19 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:40:19 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:40:19 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:40:19 user nova-compute[75292]:   <serial>53acb8af-84ea-4276-8700-b4deb2374287</serial>
Nov 14 14:40:19 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 14:40:19 user nova-compute[75292]: </disk>
Nov 14 14:40:19 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:40:19 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully detached device vdb from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the persistent domain config.
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:40:19 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:40:19 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:40:19 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:40:19 user nova-compute[75292]:   <serial>53acb8af-84ea-4276-8700-b4deb2374287</serial>
Nov 14 14:40:19 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 14:40:19 user nova-compute[75292]: </disk>
Nov 14 14:40:19 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updated VIF entry in instance network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f513d13f-ddb4-4f59-81ae-7d6f6d3e8fc3 req-f0fde0e5-d3ee-4383-8e39-4315b49624d7 service nova] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:21 user nova-compute[75292]: INFO nova.compute.manager [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Rebooting instance
Nov 14 14:40:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:22 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance destroyed successfully.
Nov 14 14:40:22 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'resources' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517126303',display_name='tempest-TestMinimumBasicScenario-server-1517126303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517126303',id=20,image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt2ywkWaNq23mGaooT+uHlWwwF9vKnixAx9vlSB9Q+NH/mta3IUdPVfprVjztpV2oEZGR1682f2+QsXbgBCUqyOv5ngZDC8JDUuZQKtpzMw3ekrQHi9AjN7o6iH3rdSsg==',key_name='tempest-TestMinimumBasicScenario-1832686439',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-qbxoq5lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:40:22Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=7397dbe8-471b-40b2-8dea-cc8078a92a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfea62a5d-74, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5986fa6-15bf-40d7-aabc-0da6d02ad210) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:23 user nova-compute[75292]: INFO os_vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74')
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84d5e2c-5c00-46fe-a1f8-754f5ae523f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:40:23 user nova-compute[75292]: No targets found.
Nov 14 14:40:23 user nova-compute[75292]: iSNS:
Nov 14 14:40:23 user nova-compute[75292]: No targets found.
Nov 14 14:40:23 user nova-compute[75292]: STATIC:
Nov 14 14:40:23 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:40:23 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:23 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:23 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287
Nov 14 14:40:23 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:23 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:23 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:40:23 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:23 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:23 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:40:23 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:23 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:23 user nova-compute[75292]: FIRMWARE:
Nov 14 14:40:23 user nova-compute[75292]: No targets found.
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:40:23 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:40:23 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9173d2-2972-4371-aefa-fcad5ac325fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d6bcd-9ae0-41b8-ad92-604af402d159]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c242e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be9c16-3772-4f02-8add-d5c52c5a8acb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0fe420-19cf-4750-8c61-2e4a74047727]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9ef8bf-715f-43a2-92e9-d6cbebdae5b6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a99fd3-9447-49b6-a220-7f46d2fc9e58]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc6f333-757f-4070-866b-90d3427ef82d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdb1bf1-09ba-4676-9587-e06e7389b244]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]
Nov 14 14:40:23 user nova-compute[75292]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afec616-6714-4561-98d5-6fc8c11aa6f3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== disconnect_volume: return (338ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Start _get_guest_xml network_info=[{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30789dba-62a6-4cf2-a865-f871f696c6f0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '30789dba-62a6-4cf2-a865-f871f696c6f0'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ebf5cc7d-7acb-458e-b787-cc9c5c147297', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7397dbe8-471b-40b2-8dea-cc8078a92a77', 'attached_at': '', 'detached_at': '', 'volume_id': '50f9263a-8520-4dc4-8601-b7b181497488', 'serial': '50f9263a-8520-4dc4-8601-b7b181497488'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:40:23 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:40:23 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=30789dba-62a6-4cf2-a865-f871f696c6f0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.objects.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Object Instance<7397dbe8-471b-40b2-8dea-cc8078a92a77> lazy-loaded attributes: resources,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:23 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f38aa5-dbaf-4921-84ea-a22754c2f8dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:40:23 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26c7a4b-5f83-4b7e-bf6b-2d5259285db2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488] added
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c75a5a4-3cc2-4e23-959e-c6465b28d9fa]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7dcf25-97f5-4644-9fc2-5be0ccfdca53]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSAyUDgC {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rSAyUDgC" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[25477f20-e65a-499d-b7a3-463210b7001e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rSAyUDgC'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59836bb9-4103-4f2e-9118-8efab9106e7b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1cde07-ed4d-4481-a352-3275a154d65f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f987a5-7a65-48db-85f2-620062cd34ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]
Nov 14 14:40:23 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfe7281-b2f7-4f25-a14f-f150365eb75e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e280454f-8cb1-43e8-99e0-b69d24c6d09b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d505142c-acfc-4606-9cbb-8c132164ac09]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26133633065393961', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133633065393961', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517126303',display_name='tempest-TestMinimumBasicScenario-server-1517126303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517126303',id=20,image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt2ywkWaNq23mGaooT+uHlWwwF9vKnixAx9vlSB9Q+NH/mta3IUdPVfprVjztpV2oEZGR1682f2+QsXbgBCUqyOv5ngZDC8JDUuZQKtpzMw3ekrQHi9AjN7o6iH3rdSsg==',key_name='tempest-TestMinimumBasicScenario-1832686439',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-qbxoq5lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:40:22Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=7397dbe8-471b-40b2-8dea-cc8078a92a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'pci_devices' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.objects.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Object Instance<7397dbe8-471b-40b2-8dea-cc8078a92a77> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:40:24 user nova-compute[75292]:   <uuid>7397dbe8-471b-40b2-8dea-cc8078a92a77</uuid>
Nov 14 14:40:24 user nova-compute[75292]:   <name>instance-00000014</name>
Nov 14 14:40:24 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:40:24 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:40:24 user nova-compute[75292]:   <metadata>
Nov 14 14:40:24 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:40:24 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:40:24 user nova-compute[75292]:       <nova:name>tempest-TestMinimumBasicScenario-server-1517126303</nova:name>
Nov 14 14:40:24 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:40:23</nova:creationTime>
Nov 14 14:40:24 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:40:24 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:40:24 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:40:24 user nova-compute[75292]:       <nova:owner>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:user uuid="8f20ed29c2964cf5bc164dc614dcb97c">tempest-TestMinimumBasicScenario-364849145-project-member</nova:user>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:project uuid="d4452a2c5ea7451997f344226737bf38">tempest-TestMinimumBasicScenario-364849145</nova:project>
Nov 14 14:40:24 user nova-compute[75292]:       </nova:owner>
Nov 14 14:40:24 user nova-compute[75292]:       <nova:root type="image" uuid="30789dba-62a6-4cf2-a865-f871f696c6f0"/>
Nov 14 14:40:24 user nova-compute[75292]:       <nova:ports>
Nov 14 14:40:24 user nova-compute[75292]:         <nova:port uuid="fea62a5d-74a2-4285-80fc-85b092e61f1a">
Nov 14 14:40:24 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 14:40:24 user nova-compute[75292]:         </nova:port>
Nov 14 14:40:24 user nova-compute[75292]:       </nova:ports>
Nov 14 14:40:24 user nova-compute[75292]:     </nova:instance>
Nov 14 14:40:24 user nova-compute[75292]:   </metadata>
Nov 14 14:40:24 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:40:24 user nova-compute[75292]:     <system>
Nov 14 14:40:24 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:40:24 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:40:24 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:40:24 user nova-compute[75292]:       <entry name="serial">7397dbe8-471b-40b2-8dea-cc8078a92a77</entry>
Nov 14 14:40:24 user nova-compute[75292]:       <entry name="uuid">7397dbe8-471b-40b2-8dea-cc8078a92a77</entry>
Nov 14 14:40:24 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:40:24 user nova-compute[75292]:     </system>
Nov 14 14:40:24 user nova-compute[75292]:   </sysinfo>
Nov 14 14:40:24 user nova-compute[75292]:   <os>
Nov 14 14:40:24 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:40:24 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:40:24 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:40:24 user nova-compute[75292]:   </os>
Nov 14 14:40:24 user nova-compute[75292]:   <features>
Nov 14 14:40:24 user nova-compute[75292]:     <acpi/>
Nov 14 14:40:24 user nova-compute[75292]:     <apic/>
Nov 14 14:40:24 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:40:24 user nova-compute[75292]:   </features>
Nov 14 14:40:24 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:40:24 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:40:24 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:40:24 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:40:24 user nova-compute[75292]:   </clock>
Nov 14 14:40:24 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:40:24 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:40:24 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:40:24 user nova-compute[75292]:   </cpu>
Nov 14 14:40:24 user nova-compute[75292]:   <devices>
Nov 14 14:40:24 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:40:24 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:40:24 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk"/>
Nov 14 14:40:24 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:40:24 user nova-compute[75292]:     </disk>
Nov 14 14:40:24 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:40:24 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:40:24 user nova-compute[75292]:       <source dev="/dev/sde"/>
Nov 14 14:40:24 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:40:24 user nova-compute[75292]:       <serial>50f9263a-8520-4dc4-8601-b7b181497488</serial>
Nov 14 14:40:24 user nova-compute[75292]:     </disk>
Nov 14 14:40:24 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:40:24 user nova-compute[75292]:       <mac address="fa:16:3e:fe:e0:43"/>
Nov 14 14:40:24 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:40:24 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:40:24 user nova-compute[75292]:       <target dev="tapfea62a5d-74"/>
Nov 14 14:40:24 user nova-compute[75292]:     </interface>
Nov 14 14:40:24 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:40:24 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/console.log" append="off"/>
Nov 14 14:40:24 user nova-compute[75292]:     </serial>
Nov 14 14:40:24 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:40:24 user nova-compute[75292]:     <video>
Nov 14 14:40:24 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:40:24 user nova-compute[75292]:     </video>
Nov 14 14:40:24 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:40:24 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:40:24 user nova-compute[75292]:     </rng>
Nov 14 14:40:24 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:40:24 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:40:24 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:40:24 user nova-compute[75292]:     </memballoon>
Nov 14 14:40:24 user nova-compute[75292]:   </devices>
Nov 14 14:40:24 user nova-compute[75292]: </domain>
Nov 14 14:40:24 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:40:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.objects.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Object Instance<7397dbe8-471b-40b2-8dea-cc8078a92a77> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c --force-share --output=json" returned: 0 in 0.164s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Cannot resize image /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'migration_context' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.objects.base [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Object Instance<7397dbe8-471b-40b2-8dea-cc8078a92a77> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517126303',display_name='tempest-TestMinimumBasicScenario-server-1517126303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517126303',id=20,image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt2ywkWaNq23mGaooT+uHlWwwF9vKnixAx9vlSB9Q+NH/mta3IUdPVfprVjztpV2oEZGR1682f2+QsXbgBCUqyOv5ngZDC8JDUuZQKtpzMw3ekrQHi9AjN7o6iH3rdSsg==',key_name='tempest-TestMinimumBasicScenario-1832686439',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-qbxoq5lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:40:22Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=7397dbe8-471b-40b2-8dea-cc8078a92a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG os_vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a1ee8f6-b002-5a8a-af24-1752a5048676', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfea62a5d-74, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfea62a5d-74, col_values=(('qos', UUID('5e59c102-60bf-4ecf-842f-57cfe0c8df8c')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfea62a5d-74, col_values=(('external_ids', {'iface-id': 'fea62a5d-74a2-4285-80fc-85b092e61f1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:e0:43', 'vm-uuid': '7397dbe8-471b-40b2-8dea-cc8078a92a77'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:25 user nova-compute[75292]: INFO os_vif [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74')
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:40:26 user nova-compute[75292]: INFO nova.compute.claims [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Claim successful on node user
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:40:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.policy [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8511393be8fa40cd97118906de2d83e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99d41ce185fa4a338faf970a4fe98a79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:40:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Creating image(s)
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "/opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "/opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "/opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.211s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk 1073741824" returned: 0 in 0.066s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Successfully created port: 53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.224s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Cannot resize image /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Ensure instance console log exists: /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-9bc54e14-1229-4751-8406-a97e62e2d82c req-a17226f3-6197-4106-ae37-c99c6ee1d23c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-unplugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9bc54e14-1229-4751-8406-a97e62e2d82c req-a17226f3-6197-4106-ae37-c99c6ee1d23c service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9bc54e14-1229-4751-8406-a97e62e2d82c req-a17226f3-6197-4106-ae37-c99c6ee1d23c service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9bc54e14-1229-4751-8406-a97e62e2d82c req-a17226f3-6197-4106-ae37-c99c6ee1d23c service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-9bc54e14-1229-4751-8406-a97e62e2d82c req-a17226f3-6197-4106-ae37-c99c6ee1d23c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-unplugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:27 user nova-compute[75292]: WARNING nova.compute.manager [req-9bc54e14-1229-4751-8406-a97e62e2d82c req-a17226f3-6197-4106-ae37-c99c6ee1d23c service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-unplugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state active and task_state reboot_started_hard.
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Successfully updated port: 53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquired lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-changed-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Refreshing instance network info cache due to event network-changed-53a879f8-37fd-432d-900f-44d9ab80fcf8. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] Acquiring lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updating instance_info_cache with network_info: [{"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Releasing lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Instance network_info: |[{"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] Acquired lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Refreshing network info cache for port 53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Start _get_guest_xml network_info=[{"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:40:28 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:40:28 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2003982180',display_name='tempest-TestServerVolumeAttachmentScenario-server-2003982180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2003982180',id=23,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKalpf3WM5zDicVRpbCzJjv6ZyP/RIRfraAclF0Tch53sySwDZMUZhYZyYjKmwoiU9ksMTjjGLdol7AA0spSh9oqTi4eccj2sW2MHQShm4bvwNVEg8HlOGpKgXOgE4iV8g==',key_name='tempest-keypair-1153133975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99d41ce185fa4a338faf970a4fe98a79',ramdisk_id='',reservation_id='r-eomgww6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1845144713',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1845144713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8511393be8fa40cd97118906de2d83e0',uuid=f97410b4-b961-4b67-be80-49404e1849b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Converting VIF {"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'pci_devices' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:40:28 user nova-compute[75292]:   <uuid>f97410b4-b961-4b67-be80-49404e1849b2</uuid>
Nov 14 14:40:28 user nova-compute[75292]:   <name>instance-00000017</name>
Nov 14 14:40:28 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:40:28 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:40:28 user nova-compute[75292]:   <metadata>
Nov 14 14:40:28 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:40:28 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:40:28 user nova-compute[75292]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2003982180</nova:name>
Nov 14 14:40:28 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:40:28</nova:creationTime>
Nov 14 14:40:28 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:40:28 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:40:28 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:40:28 user nova-compute[75292]:       <nova:owner>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:user uuid="8511393be8fa40cd97118906de2d83e0">tempest-TestServerVolumeAttachmentScenario-1845144713-project-member</nova:user>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:project uuid="99d41ce185fa4a338faf970a4fe98a79">tempest-TestServerVolumeAttachmentScenario-1845144713</nova:project>
Nov 14 14:40:28 user nova-compute[75292]:       </nova:owner>
Nov 14 14:40:28 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:40:28 user nova-compute[75292]:       <nova:ports>
Nov 14 14:40:28 user nova-compute[75292]:         <nova:port uuid="53a879f8-37fd-432d-900f-44d9ab80fcf8">
Nov 14 14:40:28 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 14:40:28 user nova-compute[75292]:         </nova:port>
Nov 14 14:40:28 user nova-compute[75292]:       </nova:ports>
Nov 14 14:40:28 user nova-compute[75292]:     </nova:instance>
Nov 14 14:40:28 user nova-compute[75292]:   </metadata>
Nov 14 14:40:28 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:40:28 user nova-compute[75292]:     <system>
Nov 14 14:40:28 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:40:28 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:40:28 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:40:28 user nova-compute[75292]:       <entry name="serial">f97410b4-b961-4b67-be80-49404e1849b2</entry>
Nov 14 14:40:28 user nova-compute[75292]:       <entry name="uuid">f97410b4-b961-4b67-be80-49404e1849b2</entry>
Nov 14 14:40:28 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:40:28 user nova-compute[75292]:     </system>
Nov 14 14:40:28 user nova-compute[75292]:   </sysinfo>
Nov 14 14:40:28 user nova-compute[75292]:   <os>
Nov 14 14:40:28 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:40:28 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:40:28 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:40:28 user nova-compute[75292]:   </os>
Nov 14 14:40:28 user nova-compute[75292]:   <features>
Nov 14 14:40:28 user nova-compute[75292]:     <acpi/>
Nov 14 14:40:28 user nova-compute[75292]:     <apic/>
Nov 14 14:40:28 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:40:28 user nova-compute[75292]:   </features>
Nov 14 14:40:28 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:40:28 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:40:28 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:40:28 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:40:28 user nova-compute[75292]:   </clock>
Nov 14 14:40:28 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:40:28 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:40:28 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:40:28 user nova-compute[75292]:   </cpu>
Nov 14 14:40:28 user nova-compute[75292]:   <devices>
Nov 14 14:40:28 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:40:28 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:40:28 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk"/>
Nov 14 14:40:28 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:40:28 user nova-compute[75292]:     </disk>
Nov 14 14:40:28 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:40:28 user nova-compute[75292]:       <mac address="fa:16:3e:71:d2:d1"/>
Nov 14 14:40:28 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:40:28 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:40:28 user nova-compute[75292]:       <target dev="tap53a879f8-37"/>
Nov 14 14:40:28 user nova-compute[75292]:     </interface>
Nov 14 14:40:28 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:40:28 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/console.log" append="off"/>
Nov 14 14:40:28 user nova-compute[75292]:     </serial>
Nov 14 14:40:28 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:40:28 user nova-compute[75292]:     <video>
Nov 14 14:40:28 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:40:28 user nova-compute[75292]:     </video>
Nov 14 14:40:28 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:40:28 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:40:28 user nova-compute[75292]:     </rng>
Nov 14 14:40:28 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:40:28 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:40:28 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:40:28 user nova-compute[75292]:     </memballoon>
Nov 14 14:40:28 user nova-compute[75292]:   </devices>
Nov 14 14:40:28 user nova-compute[75292]: </domain>
Nov 14 14:40:28 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2003982180',display_name='tempest-TestServerVolumeAttachmentScenario-server-2003982180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2003982180',id=23,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKalpf3WM5zDicVRpbCzJjv6ZyP/RIRfraAclF0Tch53sySwDZMUZhYZyYjKmwoiU9ksMTjjGLdol7AA0spSh9oqTi4eccj2sW2MHQShm4bvwNVEg8HlOGpKgXOgE4iV8g==',key_name='tempest-keypair-1153133975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99d41ce185fa4a338faf970a4fe98a79',ramdisk_id='',reservation_id='r-eomgww6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1845144713',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1845144713-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:40:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8511393be8fa40cd97118906de2d83e0',uuid=f97410b4-b961-4b67-be80-49404e1849b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Converting VIF {"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG os_vif [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d07b167-c250-5d4f-bc91-a82cf9a18a9f', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53a879f8-37, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53a879f8-37, col_values=(('qos', UUID('afef252d-9691-49b9-bb0f-91a36fa6f438')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53a879f8-37, col_values=(('external_ids', {'iface-id': '53a879f8-37fd-432d-900f-44d9ab80fcf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:d2:d1', 'vm-uuid': 'f97410b4-b961-4b67-be80-49404e1849b2'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:28 user nova-compute[75292]: INFO os_vif [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37')
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No VIF found with MAC fa:16:3e:71:d2:d1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updated VIF entry in instance network info cache for port 53a879f8-37fd-432d-900f-44d9ab80fcf8. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG nova.network.neutron [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updating instance_info_cache with network_info: [{"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:40:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5d3fc02e-87a4-4095-891a-22f7863f9cd8 req-dcdc101f-0eda-4708-bc08-a3f2aa43e99e service nova] Releasing lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:40:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance rebooted successfully.
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2a0a7ff1-3e0c-48b4-b40c-fbf521a44d98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.555s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:29 user nova-compute[75292]: WARNING nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state active and task_state None.
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:29 user nova-compute[75292]: WARNING nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state active and task_state None.
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:29 user nova-compute[75292]: WARNING nova.compute.manager [req-fbd09f8a-2d44-4774-a29d-83ff5cb763af req-669c7cf7-9a39-4cc6-8d76-f178051b58f3 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state active and task_state None.
Nov 14 14:40:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-fc638835-8b31-464a-99c3-7797898d1774 req-b35cb901-4555-43be-9622-180e067cca30 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fc638835-8b31-464a-99c3-7797898d1774 req-b35cb901-4555-43be-9622-180e067cca30 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fc638835-8b31-464a-99c3-7797898d1774 req-b35cb901-4555-43be-9622-180e067cca30 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fc638835-8b31-464a-99c3-7797898d1774 req-b35cb901-4555-43be-9622-180e067cca30 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-fc638835-8b31-464a-99c3-7797898d1774 req-b35cb901-4555-43be-9622-180e067cca30 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:30 user nova-compute[75292]: WARNING nova.compute.manager [req-fc638835-8b31-464a-99c3-7797898d1774 req-b35cb901-4555-43be-9622-180e067cca30 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state building and task_state spawning.
Nov 14 14:40:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:40:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Instance spawned successfully.
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb5c2ebe-c5a4-40ce-8ff2-23cdd0a1431c req-78080151-df21-4cef-be60-6c0f8b3c0c7e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb5c2ebe-c5a4-40ce-8ff2-23cdd0a1431c req-78080151-df21-4cef-be60-6c0f8b3c0c7e service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb5c2ebe-c5a4-40ce-8ff2-23cdd0a1431c req-78080151-df21-4cef-be60-6c0f8b3c0c7e service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb5c2ebe-c5a4-40ce-8ff2-23cdd0a1431c req-78080151-df21-4cef-be60-6c0f8b3c0c7e service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb5c2ebe-c5a4-40ce-8ff2-23cdd0a1431c req-78080151-df21-4cef-be60-6c0f8b3c0c7e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:32 user nova-compute[75292]: WARNING nova.compute.manager [req-fb5c2ebe-c5a4-40ce-8ff2-23cdd0a1431c req-78080151-df21-4cef-be60-6c0f8b3c0c7e service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state building and task_state spawning.
Nov 14 14:40:32 user nova-compute[75292]: INFO nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 14 14:40:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:40:32 user nova-compute[75292]: INFO nova.compute.manager [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Took 6.27 seconds to build instance.
Nov 14 14:40:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d6fa0338-dac4-4da7-a010-1c3462241f88 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.369s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:39 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 is timed out.
Nov 14 14:40:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully detached device vdb from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the live domain config.
Nov 14 14:40:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMRBcaIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:39 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8525e96d-cfa9-43d1-a66f-664b20967617]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:40:39 user nova-compute[75292]: No targets found.
Nov 14 14:40:39 user nova-compute[75292]: iSNS:
Nov 14 14:40:39 user nova-compute[75292]: No targets found.
Nov 14 14:40:39 user nova-compute[75292]: STATIC:
Nov 14 14:40:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:40:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287
Nov 14 14:40:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:40:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:40:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:40:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:40:39 user nova-compute[75292]: FIRMWARE:
Nov 14 14:40:39 user nova-compute[75292]: No targets found.
Nov 14 14:40:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:40:39 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:40:39 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f53a13-5b1f-4a70-82e5-030ca5ea8ff4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908c0ca-6fde-4c3b-af2b-7fd234ce6ac8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b540fea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287'): ({'sdd'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Removing single pathed devices sdd {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6f18c8-f28d-43be-b3b6-77b2e8135c96]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a876fdc-a3f8-42cb-9546-e744ba6c0ade]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Flushing IO for device /dev/sdd {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac88d5-898b-49cd-a36c-3273ec0481d6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[78906349-0450-460e-9e14-e47a2ec199c7]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d58840-79a9-4f62-bb8a-39db96f56b45]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ab7c97-8a05-434b-ac49-be2361c08cb4]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260]
Nov 14 14:40:39 user nova-compute[75292]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53acb8af-84ea-4276-8700-b4deb2374287 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1966adb-d40c-4d77-9481-8dddb4d89fff]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] <== disconnect_volume: return (346ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'flavor' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a07253ab-03a2-4f68-b190-0350099f8029 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.725s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "interface-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-922cd2ab-2796-4f91-bcd7-60bda85d4847" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "interface-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-922cd2ab-2796-4f91-bcd7-60bda85d4847" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'flavor' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface> {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface> {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Attempting to detach device tap922cd2ab-27 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] detach device xml: <interface type="ethernet">
Nov 14 14:40:41 user nova-compute[75292]:   <mac address="fa:16:3e:d7:ca:90"/>
Nov 14 14:40:41 user nova-compute[75292]:   <model type="virtio"/>
Nov 14 14:40:41 user nova-compute[75292]:   <mtu size="1442"/>
Nov 14 14:40:41 user nova-compute[75292]:   <target dev="tap922cd2ab-27"/>
Nov 14 14:40:41 user nova-compute[75292]: </interface>
Nov 14 14:40:41 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface> {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 14 14:40:41 user nova-compute[75292]:   <name>instance-00000015</name>
Nov 14 14:40:41 user nova-compute[75292]:   <uuid>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</uuid>
Nov 14 14:40:41 user nova-compute[75292]:   <metadata>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:40:41 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:40:41 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:40:41 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:40:09</nova:creationTime>
Nov 14 14:40:41 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:40:41 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:40:41 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:40:41 user nova-compute[75292]:   <nova:owner>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:40:41 user nova-compute[75292]:   </nova:owner>
Nov 14 14:40:41 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:40:41 user nova-compute[75292]:   <nova:ports>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:40:41 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:40:41 user nova-compute[75292]:     </nova:port>
Nov 14 14:40:41 user nova-compute[75292]:     <nova:port uuid="922cd2ab-2796-4f91-bcd7-60bda85d4847">
Nov 14 14:40:41 user nova-compute[75292]:       <nova:ip type="fixed" address="10.10.10.100" ipVersion="4"/>
Nov 14 14:40:41 user nova-compute[75292]:     </nova:port>
Nov 14 14:40:41 user nova-compute[75292]:   </nova:ports>
Nov 14 14:40:41 user nova-compute[75292]: </nova:instance>
Nov 14 14:40:41 user nova-compute[75292]:   </metadata>
Nov 14 14:40:41 user nova-compute[75292]:   <memory unit='KiB'>524288</memory>
Nov 14 14:40:41 user nova-compute[75292]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 14:40:41 user nova-compute[75292]:   <vcpu placement='static'>1</vcpu>
Nov 14 14:40:41 user nova-compute[75292]:   <resource>
Nov 14 14:40:41 user nova-compute[75292]:     <partition>/machine</partition>
Nov 14 14:40:41 user nova-compute[75292]:   </resource>
Nov 14 14:40:41 user nova-compute[75292]:   <sysinfo type='smbios'>
Nov 14 14:40:41 user nova-compute[75292]:     <system>
Nov 14 14:40:41 user nova-compute[75292]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 14:40:41 user nova-compute[75292]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 14:40:41 user nova-compute[75292]:       <entry name='version'>0.0.0</entry>
Nov 14 14:40:41 user nova-compute[75292]:       <entry name='serial'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:40:41 user nova-compute[75292]:       <entry name='uuid'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:40:41 user nova-compute[75292]:       <entry name='family'>Virtual Machine</entry>
Nov 14 14:40:41 user nova-compute[75292]:     </system>
Nov 14 14:40:41 user nova-compute[75292]:   </sysinfo>
Nov 14 14:40:41 user nova-compute[75292]:   <os>
Nov 14 14:40:41 user nova-compute[75292]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 14:40:41 user nova-compute[75292]:     <boot dev='hd'/>
Nov 14 14:40:41 user nova-compute[75292]:     <smbios mode='sysinfo'/>
Nov 14 14:40:41 user nova-compute[75292]:   </os>
Nov 14 14:40:41 user nova-compute[75292]:   <features>
Nov 14 14:40:41 user nova-compute[75292]:     <acpi/>
Nov 14 14:40:41 user nova-compute[75292]:     <apic/>
Nov 14 14:40:41 user nova-compute[75292]:     <vmcoreinfo state='on'/>
Nov 14 14:40:41 user nova-compute[75292]:   </features>
Nov 14 14:40:41 user nova-compute[75292]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 14:40:41 user nova-compute[75292]:     <model fallback='forbid'>Nehalem</model>
Nov 14 14:40:41 user nova-compute[75292]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 14:40:41 user nova-compute[75292]:     <feature policy='require' name='vme'/>
Nov 14 14:40:41 user nova-compute[75292]:     <feature policy='require' name='x2apic'/>
Nov 14 14:40:41 user nova-compute[75292]:     <feature policy='require' name='hypervisor'/>
Nov 14 14:40:41 user nova-compute[75292]:   </cpu>
Nov 14 14:40:41 user nova-compute[75292]:   <clock offset='utc'>
Nov 14 14:40:41 user nova-compute[75292]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 14:40:41 user nova-compute[75292]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 14:40:41 user nova-compute[75292]:     <timer name='hpet' present='no'/>
Nov 14 14:40:41 user nova-compute[75292]:   </clock>
Nov 14 14:40:41 user nova-compute[75292]:   <on_poweroff>destroy</on_poweroff>
Nov 14 14:40:41 user nova-compute[75292]:   <on_reboot>restart</on_reboot>
Nov 14 14:40:41 user nova-compute[75292]:   <on_crash>destroy</on_crash>
Nov 14 14:40:41 user nova-compute[75292]:   <devices>
Nov 14 14:40:41 user nova-compute[75292]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 14:40:41 user nova-compute[75292]:     <disk type='file' device='disk'>
Nov 14 14:40:41 user nova-compute[75292]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 14:40:41 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk' index='2'/>
Nov 14 14:40:41 user nova-compute[75292]:       <backingStore type='file' index='3'>
Nov 14 14:40:41 user nova-compute[75292]:         <format type='raw'/>
Nov 14 14:40:41 user nova-compute[75292]:         <source file='/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b'/>
Nov 14 14:40:41 user nova-compute[75292]:         <backingStore/>
Nov 14 14:40:41 user nova-compute[75292]:       </backingStore>
Nov 14 14:40:41 user nova-compute[75292]:       <target dev='vda' bus='virtio'/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='virtio-disk0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </disk>
Nov 14 14:40:41 user nova-compute[75292]:     <disk type='file' device='cdrom'>
Nov 14 14:40:41 user nova-compute[75292]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 14:40:41 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config' index='1'/>
Nov 14 14:40:41 user nova-compute[75292]:       <backingStore/>
Nov 14 14:40:41 user nova-compute[75292]:       <target dev='hda' bus='ide'/>
Nov 14 14:40:41 user nova-compute[75292]:       <readonly/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='ide0-0-0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </disk>
Nov 14 14:40:41 user nova-compute[75292]:     <controller type='usb' index='0' model='none'>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='usb'/>
Nov 14 14:40:41 user nova-compute[75292]:     </controller>
Nov 14 14:40:41 user nova-compute[75292]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='pci.0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </controller>
Nov 14 14:40:41 user nova-compute[75292]:     <controller type='ide' index='0'>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='ide'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 14:40:41 user nova-compute[75292]:     </controller>
Nov 14 14:40:41 user nova-compute[75292]:     <interface type='ethernet'>
Nov 14 14:40:41 user nova-compute[75292]:       <mac address='fa:16:3e:0c:00:22'/>
Nov 14 14:40:41 user nova-compute[75292]:       <target dev='tapa34295b5-1a'/>
Nov 14 14:40:41 user nova-compute[75292]:       <model type='virtio'/>
Nov 14 14:40:41 user nova-compute[75292]:       <mtu size='1442'/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='net0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </interface>
Nov 14 14:40:41 user nova-compute[75292]:     <interface type='ethernet'>
Nov 14 14:40:41 user nova-compute[75292]:       <mac address='fa:16:3e:d7:ca:90'/>
Nov 14 14:40:41 user nova-compute[75292]:       <target dev='tap922cd2ab-27'/>
Nov 14 14:40:41 user nova-compute[75292]:       <model type='virtio'/>
Nov 14 14:40:41 user nova-compute[75292]:       <mtu size='1442'/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='net1'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </interface>
Nov 14 14:40:41 user nova-compute[75292]:     <serial type='pty'>
Nov 14 14:40:41 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:40:41 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:40:41 user nova-compute[75292]:       <target type='isa-serial' port='0'>
Nov 14 14:40:41 user nova-compute[75292]:         <model name='isa-serial'/>
Nov 14 14:40:41 user nova-compute[75292]:       </target>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </serial>
Nov 14 14:40:41 user nova-compute[75292]:     <console type='pty' tty='/dev/pts/11'>
Nov 14 14:40:41 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:40:41 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:40:41 user nova-compute[75292]:       <target type='serial' port='0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </console>
Nov 14 14:40:41 user nova-compute[75292]:     <input type='mouse' bus='ps2'>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='input0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </input>
Nov 14 14:40:41 user nova-compute[75292]:     <input type='keyboard' bus='ps2'>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='input1'/>
Nov 14 14:40:41 user nova-compute[75292]:     </input>
Nov 14 14:40:41 user nova-compute[75292]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Nov 14 14:40:41 user nova-compute[75292]:       <listen type='address' address='0.0.0.0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </graphics>
Nov 14 14:40:41 user nova-compute[75292]:     <audio id='1' type='none'/>
Nov 14 14:40:41 user nova-compute[75292]:     <video>
Nov 14 14:40:41 user nova-compute[75292]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='video0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </video>
Nov 14 14:40:41 user nova-compute[75292]:     <memballoon model='virtio'>
Nov 14 14:40:41 user nova-compute[75292]:       <stats period='10'/>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='balloon0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </memballoon>
Nov 14 14:40:41 user nova-compute[75292]:     <rng model='virtio'>
Nov 14 14:40:41 user nova-compute[75292]:       <backend model='random'>/dev/urandom</backend>
Nov 14 14:40:41 user nova-compute[75292]:       <alias name='rng0'/>
Nov 14 14:40:41 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 14:40:41 user nova-compute[75292]:     </rng>
Nov 14 14:40:41 user nova-compute[75292]:   </devices>
Nov 14 14:40:41 user nova-compute[75292]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 14:40:41 user nova-compute[75292]:     <label>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</label>
Nov 14 14:40:41 user nova-compute[75292]:     <imagelabel>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</imagelabel>
Nov 14 14:40:41 user nova-compute[75292]:   </seclabel>
Nov 14 14:40:41 user nova-compute[75292]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 14:40:41 user nova-compute[75292]:     <label>+64055:+108</label>
Nov 14 14:40:41 user nova-compute[75292]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 14:40:41 user nova-compute[75292]:   </seclabel>
Nov 14 14:40:41 user nova-compute[75292]: </domain>
Nov 14 14:40:41 user nova-compute[75292]:  {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 14:40:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully detached device tap922cd2ab-27 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the persistent domain config.
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] (1/8): Attempting to detach device tap922cd2ab-27 with device alias net1 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] detach device xml: <interface type="ethernet">
Nov 14 14:40:41 user nova-compute[75292]:   <mac address="fa:16:3e:d7:ca:90"/>
Nov 14 14:40:41 user nova-compute[75292]:   <model type="virtio"/>
Nov 14 14:40:41 user nova-compute[75292]:   <mtu size="1442"/>
Nov 14 14:40:41 user nova-compute[75292]:   <target dev="tap922cd2ab-27"/>
Nov 14 14:40:41 user nova-compute[75292]: </interface>
Nov 14 14:40:41 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:40:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Start waiting for the detach event from libvirt for device tap922cd2ab-27 with device alias net1 for instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-b0670b87-5f7a-4841-b44d-ee7b98f27b81 req-6db164db-97e4-419f-86c8-2401ad88487b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-unplugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0670b87-5f7a-4841-b44d-ee7b98f27b81 req-6db164db-97e4-419f-86c8-2401ad88487b service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0670b87-5f7a-4841-b44d-ee7b98f27b81 req-6db164db-97e4-419f-86c8-2401ad88487b service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0670b87-5f7a-4841-b44d-ee7b98f27b81 req-6db164db-97e4-419f-86c8-2401ad88487b service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-b0670b87-5f7a-4841-b44d-ee7b98f27b81 req-6db164db-97e4-419f-86c8-2401ad88487b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-unplugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:42 user nova-compute[75292]: WARNING nova.compute.manager [req-b0670b87-5f7a-4841-b44d-ee7b98f27b81 req-6db164db-97e4-419f-86c8-2401ad88487b service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-unplugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 for instance with vm_state active and task_state None.
Nov 14 14:40:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f153eea-d95a-499e-ad1d-8a14e989ab67 req-9441a3ee-c06c-4b16-99dc-ec0c3ee3e11e service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:40:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f153eea-d95a-499e-ad1d-8a14e989ab67 req-9441a3ee-c06c-4b16-99dc-ec0c3ee3e11e service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f153eea-d95a-499e-ad1d-8a14e989ab67 req-9441a3ee-c06c-4b16-99dc-ec0c3ee3e11e service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f153eea-d95a-499e-ad1d-8a14e989ab67 req-9441a3ee-c06c-4b16-99dc-ec0c3ee3e11e service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f153eea-d95a-499e-ad1d-8a14e989ab67 req-9441a3ee-c06c-4b16-99dc-ec0c3ee3e11e service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:40:44 user nova-compute[75292]: WARNING nova.compute.manager [req-1f153eea-d95a-499e-ad1d-8a14e989ab67 req-9441a3ee-c06c-4b16-99dc-ec0c3ee3e11e service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-plugged-922cd2ab-2796-4f91-bcd7-60bda85d4847 for instance with vm_state active and task_state None.
Nov 14 14:40:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'flavor' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:40:54 user nova-compute[75292]: INFO nova.compute.manager [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Attaching volume ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 to /dev/vdb
Nov 14 14:40:54 user nova-compute[75292]: DEBUG os_brick.utils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b586b-d69c-4ed7-ace2-f7c1e5afaf5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3c67dd-7470-48c4-b763-c75e1eeb4c6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[075127a7-4e8a-464b-af34-ceded03b559c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc496e-1d4e-4256-9554-538b32f0cf57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:40:54 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:40:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd86cf-e0bb-452f-8e33-8ddd390e1544]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG os_brick.utils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating existing volume attachment record: 52ba2de2-e346-408c-9595-84c69b7657f2 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:40:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nxQhMPJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:40:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:40:59 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[98264689-e279-4f1d-b191-4a6d98fe7d57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:40:59 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e5a5bc-108c-4ba7-951d-dc27de7a64fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85] added
Nov 14 14:40:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfad52-5e13-4e82-994e-2ca5c39804c3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[855552b1-7409-4721-b539-91368bd5048e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nxQhMPJg {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nxQhMPJg" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea94f8-1f2d-4fab-81b1-772fc123ce65]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nxQhMPJg'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa3d95-773f-4223-9c9c-b973cd8b5e38]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb17aee-6442-417a-8dbd-7dadbcd1951d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b747c9-e231-48c1-a4f1-31aefb830b98]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260]
Nov 14 14:40:59 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260] successful.
Nov 14 14:40:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5016d07-542a-4ae7-ac60-be11a525a22d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e0b210-230c-46e4-b333-67e7f8ff8740]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:40:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d94dd-caf4-4b41-91b5-0f6d0de7d813]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:40:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nxQhMPJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:41:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:41:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23737363034663135', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:41:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737363034663135', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:41:00 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'flavor' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:41:00 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:41:00 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:41:00 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:41:00 user nova-compute[75292]:   <serial>ace0a3c1-37ad-4bfe-b1b3-cdba59134c85</serial>
Nov 14 14:41:00 user nova-compute[75292]: </disk>
Nov 14 14:41:00 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:41:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No VIF found with MAC fa:16:3e:8e:61:19, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:41:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cf23d9a9-c073-48f0-8db4-eb946d39a0e8 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.242s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:02 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Waiting for libvirt event about the detach of device tap922cd2ab-27 with device alias net1 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 is timed out.
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface> {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 14 14:41:02 user nova-compute[75292]:   <name>instance-00000015</name>
Nov 14 14:41:02 user nova-compute[75292]:   <uuid>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</uuid>
Nov 14 14:41:02 user nova-compute[75292]:   <metadata>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:02 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:40:09</nova:creationTime>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:41:02 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:ports>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:41:02 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:41:02 user nova-compute[75292]:     </nova:port>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:port uuid="922cd2ab-2796-4f91-bcd7-60bda85d4847">
Nov 14 14:41:02 user nova-compute[75292]:       <nova:ip type="fixed" address="10.10.10.100" ipVersion="4"/>
Nov 14 14:41:02 user nova-compute[75292]:     </nova:port>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:ports>
Nov 14 14:41:02 user nova-compute[75292]: </nova:instance>
Nov 14 14:41:02 user nova-compute[75292]:   </metadata>
Nov 14 14:41:02 user nova-compute[75292]:   <memory unit='KiB'>524288</memory>
Nov 14 14:41:02 user nova-compute[75292]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 14:41:02 user nova-compute[75292]:   <vcpu placement='static'>1</vcpu>
Nov 14 14:41:02 user nova-compute[75292]:   <resource>
Nov 14 14:41:02 user nova-compute[75292]:     <partition>/machine</partition>
Nov 14 14:41:02 user nova-compute[75292]:   </resource>
Nov 14 14:41:02 user nova-compute[75292]:   <sysinfo type='smbios'>
Nov 14 14:41:02 user nova-compute[75292]:     <system>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='version'>0.0.0</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='serial'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='uuid'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='family'>Virtual Machine</entry>
Nov 14 14:41:02 user nova-compute[75292]:     </system>
Nov 14 14:41:02 user nova-compute[75292]:   </sysinfo>
Nov 14 14:41:02 user nova-compute[75292]:   <os>
Nov 14 14:41:02 user nova-compute[75292]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 14:41:02 user nova-compute[75292]:     <boot dev='hd'/>
Nov 14 14:41:02 user nova-compute[75292]:     <smbios mode='sysinfo'/>
Nov 14 14:41:02 user nova-compute[75292]:   </os>
Nov 14 14:41:02 user nova-compute[75292]:   <features>
Nov 14 14:41:02 user nova-compute[75292]:     <acpi/>
Nov 14 14:41:02 user nova-compute[75292]:     <apic/>
Nov 14 14:41:02 user nova-compute[75292]:     <vmcoreinfo state='on'/>
Nov 14 14:41:02 user nova-compute[75292]:   </features>
Nov 14 14:41:02 user nova-compute[75292]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 14:41:02 user nova-compute[75292]:     <model fallback='forbid'>Nehalem</model>
Nov 14 14:41:02 user nova-compute[75292]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='vme'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='x2apic'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='hypervisor'/>
Nov 14 14:41:02 user nova-compute[75292]:   </cpu>
Nov 14 14:41:02 user nova-compute[75292]:   <clock offset='utc'>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='hpet' present='no'/>
Nov 14 14:41:02 user nova-compute[75292]:   </clock>
Nov 14 14:41:02 user nova-compute[75292]:   <on_poweroff>destroy</on_poweroff>
Nov 14 14:41:02 user nova-compute[75292]:   <on_reboot>restart</on_reboot>
Nov 14 14:41:02 user nova-compute[75292]:   <on_crash>destroy</on_crash>
Nov 14 14:41:02 user nova-compute[75292]:   <devices>
Nov 14 14:41:02 user nova-compute[75292]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 14:41:02 user nova-compute[75292]:     <disk type='file' device='disk'>
Nov 14 14:41:02 user nova-compute[75292]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 14:41:02 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk' index='2'/>
Nov 14 14:41:02 user nova-compute[75292]:       <backingStore type='file' index='3'>
Nov 14 14:41:02 user nova-compute[75292]:         <format type='raw'/>
Nov 14 14:41:02 user nova-compute[75292]:         <source file='/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b'/>
Nov 14 14:41:02 user nova-compute[75292]:         <backingStore/>
Nov 14 14:41:02 user nova-compute[75292]:       </backingStore>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='vda' bus='virtio'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='virtio-disk0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </disk>
Nov 14 14:41:02 user nova-compute[75292]:     <disk type='file' device='cdrom'>
Nov 14 14:41:02 user nova-compute[75292]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 14:41:02 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config' index='1'/>
Nov 14 14:41:02 user nova-compute[75292]:       <backingStore/>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='hda' bus='ide'/>
Nov 14 14:41:02 user nova-compute[75292]:       <readonly/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='ide0-0-0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </disk>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='usb' index='0' model='none'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='usb'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='pci.0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='ide' index='0'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='ide'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <interface type='ethernet'>
Nov 14 14:41:02 user nova-compute[75292]:       <mac address='fa:16:3e:0c:00:22'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='tapa34295b5-1a'/>
Nov 14 14:41:02 user nova-compute[75292]:       <model type='virtio'/>
Nov 14 14:41:02 user nova-compute[75292]:       <mtu size='1442'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='net0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </interface>
Nov 14 14:41:02 user nova-compute[75292]:     <serial type='pty'>
Nov 14 14:41:02 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:41:02 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target type='isa-serial' port='0'>
Nov 14 14:41:02 user nova-compute[75292]:         <model name='isa-serial'/>
Nov 14 14:41:02 user nova-compute[75292]:       </target>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </serial>
Nov 14 14:41:02 user nova-compute[75292]:     <console type='pty' tty='/dev/pts/11'>
Nov 14 14:41:02 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:41:02 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target type='serial' port='0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </console>
Nov 14 14:41:02 user nova-compute[75292]:     <input type='mouse' bus='ps2'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='input0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </input>
Nov 14 14:41:02 user nova-compute[75292]:     <input type='keyboard' bus='ps2'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='input1'/>
Nov 14 14:41:02 user nova-compute[75292]:     </input>
Nov 14 14:41:02 user nova-compute[75292]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Nov 14 14:41:02 user nova-compute[75292]:       <listen type='address' address='0.0.0.0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </graphics>
Nov 14 14:41:02 user nova-compute[75292]:     <audio id='1' type='none'/>
Nov 14 14:41:02 user nova-compute[75292]:     <video>
Nov 14 14:41:02 user nova-compute[75292]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='video0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </video>
Nov 14 14:41:02 user nova-compute[75292]:     <memballoon model='virtio'>
Nov 14 14:41:02 user nova-compute[75292]:       <stats period='10'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='balloon0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </memballoon>
Nov 14 14:41:02 user nova-compute[75292]:     <rng model='virtio'>
Nov 14 14:41:02 user nova-compute[75292]:       <backend model='random'>/dev/urandom</backend>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='rng0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </rng>
Nov 14 14:41:02 user nova-compute[75292]:   </devices>
Nov 14 14:41:02 user nova-compute[75292]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 14:41:02 user nova-compute[75292]:     <label>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</label>
Nov 14 14:41:02 user nova-compute[75292]:     <imagelabel>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</imagelabel>
Nov 14 14:41:02 user nova-compute[75292]:   </seclabel>
Nov 14 14:41:02 user nova-compute[75292]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 14:41:02 user nova-compute[75292]:     <label>+64055:+108</label>
Nov 14 14:41:02 user nova-compute[75292]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 14:41:02 user nova-compute[75292]:   </seclabel>
Nov 14 14:41:02 user nova-compute[75292]: </domain>
Nov 14 14:41:02 user nova-compute[75292]:  {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 14:41:02 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully detached device tap922cd2ab-27 from instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 from the live domain config.
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG os_vif [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap922cd2ab-27, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=613e8124-58b5-4c6e-9f9a-f4394b87b89c) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: INFO os_vif [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27')
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:02 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:41:02</nova:creationTime>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:41:02 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:ports>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:41:02 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:41:02 user nova-compute[75292]:     </nova:port>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:ports>
Nov 14 14:41:02 user nova-compute[75292]: </nova:instance>
Nov 14 14:41:02 user nova-compute[75292]:  {{(pid=75292) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 14:41:02 user nova-compute[75292]: INFO nova.compute.manager [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Rescuing
Nov 14 14:41:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.neutron [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-deleted-922cd2ab-2796-4f91-bcd7-60bda85d4847 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:02 user nova-compute[75292]: INFO nova.compute.manager [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Neutron deleted interface 922cd2ab-2796-4f91-bcd7-60bda85d4847; detaching it from the instance and deleting it from the info cache
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquired lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.neutron [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.objects.instance [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Lazy-loading 'system_metadata' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.objects.instance [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Lazy-loading 'flavor' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.objects.base [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Object Instance<6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438> lazy-loaded attributes: system_metadata,flavor {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Converting VIF {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface> {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 14 14:41:02 user nova-compute[75292]:   <name>instance-00000015</name>
Nov 14 14:41:02 user nova-compute[75292]:   <uuid>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</uuid>
Nov 14 14:41:02 user nova-compute[75292]:   <metadata>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:02 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:41:02</nova:creationTime>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:41:02 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:ports>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:41:02 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:41:02 user nova-compute[75292]:     </nova:port>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:ports>
Nov 14 14:41:02 user nova-compute[75292]: </nova:instance>
Nov 14 14:41:02 user nova-compute[75292]:   </metadata>
Nov 14 14:41:02 user nova-compute[75292]:   <memory unit='KiB'>524288</memory>
Nov 14 14:41:02 user nova-compute[75292]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 14:41:02 user nova-compute[75292]:   <vcpu placement='static'>1</vcpu>
Nov 14 14:41:02 user nova-compute[75292]:   <resource>
Nov 14 14:41:02 user nova-compute[75292]:     <partition>/machine</partition>
Nov 14 14:41:02 user nova-compute[75292]:   </resource>
Nov 14 14:41:02 user nova-compute[75292]:   <sysinfo type='smbios'>
Nov 14 14:41:02 user nova-compute[75292]:     <system>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='version'>0.0.0</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='serial'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='uuid'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='family'>Virtual Machine</entry>
Nov 14 14:41:02 user nova-compute[75292]:     </system>
Nov 14 14:41:02 user nova-compute[75292]:   </sysinfo>
Nov 14 14:41:02 user nova-compute[75292]:   <os>
Nov 14 14:41:02 user nova-compute[75292]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 14:41:02 user nova-compute[75292]:     <boot dev='hd'/>
Nov 14 14:41:02 user nova-compute[75292]:     <smbios mode='sysinfo'/>
Nov 14 14:41:02 user nova-compute[75292]:   </os>
Nov 14 14:41:02 user nova-compute[75292]:   <features>
Nov 14 14:41:02 user nova-compute[75292]:     <acpi/>
Nov 14 14:41:02 user nova-compute[75292]:     <apic/>
Nov 14 14:41:02 user nova-compute[75292]:     <vmcoreinfo state='on'/>
Nov 14 14:41:02 user nova-compute[75292]:   </features>
Nov 14 14:41:02 user nova-compute[75292]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 14:41:02 user nova-compute[75292]:     <model fallback='forbid'>Nehalem</model>
Nov 14 14:41:02 user nova-compute[75292]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='vme'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='x2apic'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='hypervisor'/>
Nov 14 14:41:02 user nova-compute[75292]:   </cpu>
Nov 14 14:41:02 user nova-compute[75292]:   <clock offset='utc'>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='hpet' present='no'/>
Nov 14 14:41:02 user nova-compute[75292]:   </clock>
Nov 14 14:41:02 user nova-compute[75292]:   <on_poweroff>destroy</on_poweroff>
Nov 14 14:41:02 user nova-compute[75292]:   <on_reboot>restart</on_reboot>
Nov 14 14:41:02 user nova-compute[75292]:   <on_crash>destroy</on_crash>
Nov 14 14:41:02 user nova-compute[75292]:   <devices>
Nov 14 14:41:02 user nova-compute[75292]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 14:41:02 user nova-compute[75292]:     <disk type='file' device='disk'>
Nov 14 14:41:02 user nova-compute[75292]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 14:41:02 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk' index='2'/>
Nov 14 14:41:02 user nova-compute[75292]:       <backingStore type='file' index='3'>
Nov 14 14:41:02 user nova-compute[75292]:         <format type='raw'/>
Nov 14 14:41:02 user nova-compute[75292]:         <source file='/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b'/>
Nov 14 14:41:02 user nova-compute[75292]:         <backingStore/>
Nov 14 14:41:02 user nova-compute[75292]:       </backingStore>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='vda' bus='virtio'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='virtio-disk0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </disk>
Nov 14 14:41:02 user nova-compute[75292]:     <disk type='file' device='cdrom'>
Nov 14 14:41:02 user nova-compute[75292]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 14:41:02 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config' index='1'/>
Nov 14 14:41:02 user nova-compute[75292]:       <backingStore/>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='hda' bus='ide'/>
Nov 14 14:41:02 user nova-compute[75292]:       <readonly/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='ide0-0-0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </disk>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='usb' index='0' model='none'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='usb'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='pci.0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='ide' index='0'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='ide'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <interface type='ethernet'>
Nov 14 14:41:02 user nova-compute[75292]:       <mac address='fa:16:3e:0c:00:22'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='tapa34295b5-1a'/>
Nov 14 14:41:02 user nova-compute[75292]:       <model type='virtio'/>
Nov 14 14:41:02 user nova-compute[75292]:       <mtu size='1442'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='net0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </interface>
Nov 14 14:41:02 user nova-compute[75292]:     <serial type='pty'>
Nov 14 14:41:02 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:41:02 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target type='isa-serial' port='0'>
Nov 14 14:41:02 user nova-compute[75292]:         <model name='isa-serial'/>
Nov 14 14:41:02 user nova-compute[75292]:       </target>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </serial>
Nov 14 14:41:02 user nova-compute[75292]:     <console type='pty' tty='/dev/pts/11'>
Nov 14 14:41:02 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:41:02 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target type='serial' port='0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </console>
Nov 14 14:41:02 user nova-compute[75292]:     <input type='mouse' bus='ps2'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='input0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </input>
Nov 14 14:41:02 user nova-compute[75292]:     <input type='keyboard' bus='ps2'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='input1'/>
Nov 14 14:41:02 user nova-compute[75292]:     </input>
Nov 14 14:41:02 user nova-compute[75292]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Nov 14 14:41:02 user nova-compute[75292]:       <listen type='address' address='0.0.0.0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </graphics>
Nov 14 14:41:02 user nova-compute[75292]:     <audio id='1' type='none'/>
Nov 14 14:41:02 user nova-compute[75292]:     <video>
Nov 14 14:41:02 user nova-compute[75292]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='video0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </video>
Nov 14 14:41:02 user nova-compute[75292]:     <memballoon model='virtio'>
Nov 14 14:41:02 user nova-compute[75292]:       <stats period='10'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='balloon0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </memballoon>
Nov 14 14:41:02 user nova-compute[75292]:     <rng model='virtio'>
Nov 14 14:41:02 user nova-compute[75292]:       <backend model='random'>/dev/urandom</backend>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='rng0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </rng>
Nov 14 14:41:02 user nova-compute[75292]:   </devices>
Nov 14 14:41:02 user nova-compute[75292]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 14:41:02 user nova-compute[75292]:     <label>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</label>
Nov 14 14:41:02 user nova-compute[75292]:     <imagelabel>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</imagelabel>
Nov 14 14:41:02 user nova-compute[75292]:   </seclabel>
Nov 14 14:41:02 user nova-compute[75292]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 14:41:02 user nova-compute[75292]:     <label>+64055:+108</label>
Nov 14 14:41:02 user nova-compute[75292]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 14:41:02 user nova-compute[75292]:   </seclabel>
Nov 14 14:41:02 user nova-compute[75292]: </domain>
Nov 14 14:41:02 user nova-compute[75292]:  {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface> {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d7:ca:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap922cd2ab-27"/></interface>not found in domain: <domain type='kvm' id='24'>
Nov 14 14:41:02 user nova-compute[75292]:   <name>instance-00000015</name>
Nov 14 14:41:02 user nova-compute[75292]:   <uuid>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</uuid>
Nov 14 14:41:02 user nova-compute[75292]:   <metadata>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:02 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:41:02</nova:creationTime>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:41:02 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:ports>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:41:02 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:41:02 user nova-compute[75292]:     </nova:port>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:ports>
Nov 14 14:41:02 user nova-compute[75292]: </nova:instance>
Nov 14 14:41:02 user nova-compute[75292]:   </metadata>
Nov 14 14:41:02 user nova-compute[75292]:   <memory unit='KiB'>524288</memory>
Nov 14 14:41:02 user nova-compute[75292]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 14:41:02 user nova-compute[75292]:   <vcpu placement='static'>1</vcpu>
Nov 14 14:41:02 user nova-compute[75292]:   <resource>
Nov 14 14:41:02 user nova-compute[75292]:     <partition>/machine</partition>
Nov 14 14:41:02 user nova-compute[75292]:   </resource>
Nov 14 14:41:02 user nova-compute[75292]:   <sysinfo type='smbios'>
Nov 14 14:41:02 user nova-compute[75292]:     <system>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='version'>0.0.0</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='serial'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='uuid'>6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</entry>
Nov 14 14:41:02 user nova-compute[75292]:       <entry name='family'>Virtual Machine</entry>
Nov 14 14:41:02 user nova-compute[75292]:     </system>
Nov 14 14:41:02 user nova-compute[75292]:   </sysinfo>
Nov 14 14:41:02 user nova-compute[75292]:   <os>
Nov 14 14:41:02 user nova-compute[75292]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 14:41:02 user nova-compute[75292]:     <boot dev='hd'/>
Nov 14 14:41:02 user nova-compute[75292]:     <smbios mode='sysinfo'/>
Nov 14 14:41:02 user nova-compute[75292]:   </os>
Nov 14 14:41:02 user nova-compute[75292]:   <features>
Nov 14 14:41:02 user nova-compute[75292]:     <acpi/>
Nov 14 14:41:02 user nova-compute[75292]:     <apic/>
Nov 14 14:41:02 user nova-compute[75292]:     <vmcoreinfo state='on'/>
Nov 14 14:41:02 user nova-compute[75292]:   </features>
Nov 14 14:41:02 user nova-compute[75292]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 14:41:02 user nova-compute[75292]:     <model fallback='forbid'>Nehalem</model>
Nov 14 14:41:02 user nova-compute[75292]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='vme'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='x2apic'/>
Nov 14 14:41:02 user nova-compute[75292]:     <feature policy='require' name='hypervisor'/>
Nov 14 14:41:02 user nova-compute[75292]:   </cpu>
Nov 14 14:41:02 user nova-compute[75292]:   <clock offset='utc'>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 14:41:02 user nova-compute[75292]:     <timer name='hpet' present='no'/>
Nov 14 14:41:02 user nova-compute[75292]:   </clock>
Nov 14 14:41:02 user nova-compute[75292]:   <on_poweroff>destroy</on_poweroff>
Nov 14 14:41:02 user nova-compute[75292]:   <on_reboot>restart</on_reboot>
Nov 14 14:41:02 user nova-compute[75292]:   <on_crash>destroy</on_crash>
Nov 14 14:41:02 user nova-compute[75292]:   <devices>
Nov 14 14:41:02 user nova-compute[75292]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 14:41:02 user nova-compute[75292]:     <disk type='file' device='disk'>
Nov 14 14:41:02 user nova-compute[75292]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 14:41:02 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk' index='2'/>
Nov 14 14:41:02 user nova-compute[75292]:       <backingStore type='file' index='3'>
Nov 14 14:41:02 user nova-compute[75292]:         <format type='raw'/>
Nov 14 14:41:02 user nova-compute[75292]:         <source file='/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b'/>
Nov 14 14:41:02 user nova-compute[75292]:         <backingStore/>
Nov 14 14:41:02 user nova-compute[75292]:       </backingStore>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='vda' bus='virtio'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='virtio-disk0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </disk>
Nov 14 14:41:02 user nova-compute[75292]:     <disk type='file' device='cdrom'>
Nov 14 14:41:02 user nova-compute[75292]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 14:41:02 user nova-compute[75292]:       <source file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk.config' index='1'/>
Nov 14 14:41:02 user nova-compute[75292]:       <backingStore/>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='hda' bus='ide'/>
Nov 14 14:41:02 user nova-compute[75292]:       <readonly/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='ide0-0-0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </disk>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='usb' index='0' model='none'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='usb'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='pci.0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <controller type='ide' index='0'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='ide'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 14:41:02 user nova-compute[75292]:     </controller>
Nov 14 14:41:02 user nova-compute[75292]:     <interface type='ethernet'>
Nov 14 14:41:02 user nova-compute[75292]:       <mac address='fa:16:3e:0c:00:22'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target dev='tapa34295b5-1a'/>
Nov 14 14:41:02 user nova-compute[75292]:       <model type='virtio'/>
Nov 14 14:41:02 user nova-compute[75292]:       <mtu size='1442'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='net0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </interface>
Nov 14 14:41:02 user nova-compute[75292]:     <serial type='pty'>
Nov 14 14:41:02 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:41:02 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target type='isa-serial' port='0'>
Nov 14 14:41:02 user nova-compute[75292]:         <model name='isa-serial'/>
Nov 14 14:41:02 user nova-compute[75292]:       </target>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </serial>
Nov 14 14:41:02 user nova-compute[75292]:     <console type='pty' tty='/dev/pts/11'>
Nov 14 14:41:02 user nova-compute[75292]:       <source path='/dev/pts/11'/>
Nov 14 14:41:02 user nova-compute[75292]:       <log file='/opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/console.log' append='off'/>
Nov 14 14:41:02 user nova-compute[75292]:       <target type='serial' port='0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='serial0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </console>
Nov 14 14:41:02 user nova-compute[75292]:     <input type='mouse' bus='ps2'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='input0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </input>
Nov 14 14:41:02 user nova-compute[75292]:     <input type='keyboard' bus='ps2'>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='input1'/>
Nov 14 14:41:02 user nova-compute[75292]:     </input>
Nov 14 14:41:02 user nova-compute[75292]:     <graphics type='vnc' port='5911' autoport='yes' listen='0.0.0.0'>
Nov 14 14:41:02 user nova-compute[75292]:       <listen type='address' address='0.0.0.0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </graphics>
Nov 14 14:41:02 user nova-compute[75292]:     <audio id='1' type='none'/>
Nov 14 14:41:02 user nova-compute[75292]:     <video>
Nov 14 14:41:02 user nova-compute[75292]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='video0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </video>
Nov 14 14:41:02 user nova-compute[75292]:     <memballoon model='virtio'>
Nov 14 14:41:02 user nova-compute[75292]:       <stats period='10'/>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='balloon0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </memballoon>
Nov 14 14:41:02 user nova-compute[75292]:     <rng model='virtio'>
Nov 14 14:41:02 user nova-compute[75292]:       <backend model='random'>/dev/urandom</backend>
Nov 14 14:41:02 user nova-compute[75292]:       <alias name='rng0'/>
Nov 14 14:41:02 user nova-compute[75292]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 14:41:02 user nova-compute[75292]:     </rng>
Nov 14 14:41:02 user nova-compute[75292]:   </devices>
Nov 14 14:41:02 user nova-compute[75292]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 14:41:02 user nova-compute[75292]:     <label>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</label>
Nov 14 14:41:02 user nova-compute[75292]:     <imagelabel>libvirt-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438</imagelabel>
Nov 14 14:41:02 user nova-compute[75292]:   </seclabel>
Nov 14 14:41:02 user nova-compute[75292]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 14:41:02 user nova-compute[75292]:     <label>+64055:+108</label>
Nov 14 14:41:02 user nova-compute[75292]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 14:41:02 user nova-compute[75292]:   </seclabel>
Nov 14 14:41:02 user nova-compute[75292]: </domain>
Nov 14 14:41:02 user nova-compute[75292]:  {{(pid=75292) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 14:41:02 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Detaching interface fa:16:3e:d7:ca:90 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap922cd2ab-27' not found.
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Converting VIF {"id": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "address": "fa:16:3e:d7:ca:90", "network": {"id": "9dbff25c-c880-441d-8606-524aaab3ae7a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1173885350", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap922cd2ab-27", "ovs_interfaceid": "922cd2ab-2796-4f91-bcd7-60bda85d4847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG os_vif [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap922cd2ab-27, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:41:02 user nova-compute[75292]: INFO os_vif [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:ca:90,bridge_name='br-int',has_traffic_filtering=True,id=922cd2ab-2796-4f91-bcd7-60bda85d4847,network=Network(9dbff25c-c880-441d-8606-524aaab3ae7a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap922cd2ab-27')
Nov 14 14:41:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [req-b2096343-a584-4258-bf36-b97bd199ec68 req-52688cfb-2126-461e-bb9f-71090a4d60cb service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:02 user nova-compute[75292]:   <nova:package version="0.0.0"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:name>tempest-device-tagging-server-798006360</nova:name>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:creationTime>2023-11-14 14:41:02</nova:creationTime>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:flavor name="m1.tiny">
Nov 14 14:41:02 user nova-compute[75292]:     <nova:memory>512</nova:memory>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:disk>1</nova:disk>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:swap>0</nova:swap>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:flavor>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:user uuid="0f9145d6e9f947d78220d587fe76fa99">tempest-TaggedAttachmentsTest-1397313175-project-member</nova:user>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:project uuid="ed7f4b849d66445b847310e31ebb139e">tempest-TaggedAttachmentsTest-1397313175</nova:project>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:owner>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:02 user nova-compute[75292]:   <nova:ports>
Nov 14 14:41:02 user nova-compute[75292]:     <nova:port uuid="a34295b5-1ac7-44b4-b7a6-1a0a12232f5c">
Nov 14 14:41:02 user nova-compute[75292]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:41:02 user nova-compute[75292]:     </nova:port>
Nov 14 14:41:02 user nova-compute[75292]:   </nova:ports>
Nov 14 14:41:02 user nova-compute[75292]: </nova:instance>
Nov 14 14:41:02 user nova-compute[75292]:  {{(pid=75292) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 14:41:03 user nova-compute[75292]: INFO nova.network.neutron [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Port 922cd2ab-2796-4f91-bcd7-60bda85d4847 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 14 14:41:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [{"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Releasing lock "refresh_cache-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-803bdddd-0f06-4490-92a2-8c95b824e382 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "interface-6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-922cd2ab-2796-4f91-bcd7-60bda85d4847" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.650s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1fb3891-4ca3-439b-a7c3-34d70c87592a req-cc9f43d9-1bb2-4e9d-a262-4fd87e77a4e3 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1fb3891-4ca3-439b-a7c3-34d70c87592a req-cc9f43d9-1bb2-4e9d-a262-4fd87e77a4e3 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1fb3891-4ca3-439b-a7c3-34d70c87592a req-cc9f43d9-1bb2-4e9d-a262-4fd87e77a4e3 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1fb3891-4ca3-439b-a7c3-34d70c87592a req-cc9f43d9-1bb2-4e9d-a262-4fd87e77a4e3 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1fb3891-4ca3-439b-a7c3-34d70c87592a req-cc9f43d9-1bb2-4e9d-a262-4fd87e77a4e3 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:03 user nova-compute[75292]: WARNING nova.compute.manager [req-a1fb3891-4ca3-439b-a7c3-34d70c87592a req-cc9f43d9-1bb2-4e9d-a262-4fd87e77a4e3 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state active and task_state rescuing.
Nov 14 14:41:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance destroyed successfully.
Nov 14 14:41:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Attempting a stable device rescue
Nov 14 14:41:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75292) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 14:41:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:41:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Creating image(s)
Nov 14 14:41:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "c81e7ebc56003aa3e709a330a893dd39bce6afe5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "c81e7ebc56003aa3e709a330a893dd39bce6afe5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.virt.images [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] 1c6858aa-f2f5-4c12-8f0f-0552ff1ec228 was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.part /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-ddae318d-ece2-4e7d-916e-1c243c11872f req-d70d5fa3-951b-466c-a4c8-0557dc06c295 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ddae318d-ece2-4e7d-916e-1c243c11872f req-d70d5fa3-951b-466c-a4c8-0557dc06c295 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ddae318d-ece2-4e7d-916e-1c243c11872f req-d70d5fa3-951b-466c-a4c8-0557dc06c295 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ddae318d-ece2-4e7d-916e-1c243c11872f req-d70d5fa3-951b-466c-a4c8-0557dc06c295 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-ddae318d-ece2-4e7d-916e-1c243c11872f req-d70d5fa3-951b-466c-a4c8-0557dc06c295 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:05 user nova-compute[75292]: WARNING nova.compute.manager [req-ddae318d-ece2-4e7d-916e-1c243c11872f req-d70d5fa3-951b-466c-a4c8-0557dc06c295 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state active and task_state rescuing.
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:05 user nova-compute[75292]: INFO nova.compute.manager [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Terminating instance
Nov 14 14:41:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.part /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.converted" returned: 0 in 0.542s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [{"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c5ce2080-b527-4c87-b422-6de3f2d0c4d7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "c81e7ebc56003aa3e709a330a893dd39bce6afe5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.962s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "c81e7ebc56003aa3e709a330a893dd39bce6afe5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "c81e7ebc56003aa3e709a330a893dd39bce6afe5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5 --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5,backing_fmt=raw /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5,backing_fmt=raw /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue" returned: 0 in 0.064s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "c81e7ebc56003aa3e709a330a893dd39bce6afe5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'migration_context' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Object Instance<48cc4550-2634-4291-a55b-e66338585160> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Start _get_guest_xml network_info=[{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "vif_mac": "fa:16:3e:8e:61:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1c6858aa-f2f5-4c12-8f0f-0552ff1ec228', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '52ba2de2-e346-408c-9595-84c69b7657f2', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nxQhMPJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '48cc4550-2634-4291-a55b-e66338585160', 'attached_at': '', 'detached_at': '', 'volume_id': 'ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'serial': 'ace0a3c1-37ad-4bfe-b1b3-cdba59134c85'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'resources' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Object Instance<48cc4550-2634-4291-a55b-e66338585160> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'numa_topology' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Object Instance<48cc4550-2634-4291-a55b-e66338585160> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:41:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Object Instance<48cc4550-2634-4291-a55b-e66338585160> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nxQhMPJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:41:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:41:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:41:06 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Instance destroyed successfully.
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lazy-loading 'resources' on Instance uuid c483fca4-a13e-4a9c-957f-fe36ab5e3db7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2052084391',display_name='tempest-ServersNegativeTestJSON-server-2052084391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2052084391',id=22,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444dc84dbece41c6b22a37008eeb40e6',ramdisk_id='',reservation_id='r-cuxu50la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1575597503',owner_user_name='tempest-ServersNegativeTestJSON-1575597503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:39:22Z,user_data=None,user_id='533cc5752e5b4fe2b9b2f2b91bd4259a',uuid=c483fca4-a13e-4a9c-957f-fe36ab5e3db7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converting VIF {"id": "46a5a891-460f-4047-b85d-38ff7df38097", "address": "fa:16:3e:e3:23:41", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46a5a891-46", "ovs_interfaceid": "46a5a891-460f-4047-b85d-38ff7df38097", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_vif [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a4aa7-447e-44d7-a219-6337f3e85e83]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nxQhMPJg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 14:41:06 user nova-compute[75292]: node.name = iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:41:06 user nova-compute[75292]: node.tpgt = -1
Nov 14 14:41:06 user nova-compute[75292]: node.startup = automatic
Nov 14 14:41:06 user nova-compute[75292]: node.leading_login = No
Nov 14 14:41:06 user nova-compute[75292]: iface.iscsi_ifacename = default
Nov 14 14:41:06 user nova-compute[75292]: iface.net_ifacename = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.ipaddress = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.prefix_len = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.hwaddress = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.transport_name = tcp
Nov 14 14:41:06 user nova-compute[75292]: iface.initiatorname = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.vlan_id = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.vlan_priority = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.vlan_state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.iface_num = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.mtu = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.port = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.bootproto = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.subnet_mask = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.gateway = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_alt_client_id = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_dns = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_learn_iqn = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_vendor_id_state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_vendor_id = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.dhcp_slp_da = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.fragmentation = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.gratuitous_arp = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.incoming_forwarding = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.tos_state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.tos = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.ttl = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.delayed_ack = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.tcp_nagle = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.tcp_wsf_state = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.tcp_wsf = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.tcp_timer_scale = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.tcp_timestamp = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.redirect = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.def_task_mgmt_timeout = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.header_digest = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.data_digest = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.immediate_data = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.initial_r2t = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.data_seq_inorder = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.data_pdu_inorder = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.erl = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.max_receive_data_len = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.first_burst_len = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.max_outstanding_r2t = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.max_burst_len = 0
Nov 14 14:41:06 user nova-compute[75292]: iface.chap_auth = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.bidi_chap = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.strict_login_compliance = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.discovery_auth = <empty>
Nov 14 14:41:06 user nova-compute[75292]: iface.discovery_logout = <empty>
Nov 14 14:41:06 user nova-compute[75292]: node.discovery_address = <empty>
Nov 14 14:41:06 user nova-compute[75292]: node.discovery_port = 0
Nov 14 14:41:06 user nova-compute[75292]: node.discovery_type = static
Nov 14 14:41:06 user nova-compute[75292]: node.session.initial_cmdsn = 0
Nov 14 14:41:06 user nova-compute[75292]: node.session.initial_login_retry_max = 8
Nov 14 14:41:06 user nova-compute[75292]: node.session.xmit_thread_priority = -20
Nov 14 14:41:06 user nova-compute[75292]: node.session.cmds_max = 128
Nov 14 14:41:06 user nova-compute[75292]: node.session.queue_depth = 32
Nov 14 14:41:06 user nova-compute[75292]: node.session.nr_sessions = 1
Nov 14 14:41:06 user nova-compute[75292]: node.session.auth.authmethod = CHAP
Nov 14 14:41:06 user nova-compute[75292]: node.session.auth.username = nxQhMPJg
Nov 14 14:41:06 user nova-compute[75292]: node.session.auth.password = ***
Nov 14 14:41:06 user nova-compute[75292]: node.session.auth.username_in = <empty>
Nov 14 14:41:06 user nova-compute[75292]: node.session.auth.password_in = <empty>
Nov 14 14:41:06 user nova-compute[75292]: node.session.auth.chap_algs = MD5
Nov 14 14:41:06 user nova-compute[75292]: node.session.timeo.replacement_timeout = 120
Nov 14 14:41:06 user nova-compute[75292]: node.session.err_timeo.abort_timeout = 15
Nov 14 14:41:06 user nova-compute[75292]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 14:41:06 user nova-compute[75292]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 14:41:06 user nova-compute[75292]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.FastAbort = Yes
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.InitialR2T = No
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.ImmediateData = Yes
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.MaxConnections = 1
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 14:41:06 user nova-compute[75292]: node.session.iscsi.ERL = 0
Nov 14 14:41:06 user nova-compute[75292]: node.session.scan = manual
Nov 14 14:41:06 user nova-compute[75292]: node.session.reopen_max = 0
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].address = 172.16.0.220
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].port = 3260
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].startup = manual
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].tcp.window_size = 524288
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].tcp.type_of_service = 0
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].timeo.logout_timeout = 15
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].timeo.login_timeout = 15
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].timeo.auth_timeout = 45
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].iscsi.DataDigest = None
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].iscsi.IFMarker = No
Nov 14 14:41:06 user nova-compute[75292]: node.conn[0].iscsi.OFMarker = No
Nov 14 14:41:06 user nova-compute[75292]: # END RECORD
Nov 14 14:41:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46a5a891-46, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dba48d92-b48b-4cbd-9294-b23ee5e5d10c) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cfd898-4c06-4561-ac78-ee16333acc72]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:06 user nova-compute[75292]: INFO os_vif [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:23:41,bridge_name='br-int',has_traffic_filtering=True,id=46a5a891-460f-4047-b85d-38ff7df38097,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46a5a891-46')
Nov 14 14:41:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Deleting instance files /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7_del
Nov 14 14:41:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Deletion of /opt/stack/data/nova/instances/c483fca4-a13e-4a9c-957f-fe36ab5e3db7_del complete
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fdd54f-6c1f-46ad-8fdd-366c29d3bae4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nxQhMPJg {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nxQhMPJg" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1409ee-95d3-4bae-88b9-09ec4d6ce833]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nxQhMPJg'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06afb8ac-118c-487c-9cad-f9412aa0c83d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: INFO nova.compute.manager [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[285cc897-6a0b-4465-882b-4b31ea927027]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:41:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] HCTL ('35', '0', '0', 0) found on session 26 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb092c9-8fd6-49f3-929f-b3541f96097c]: (4, ('0 0 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Searching for a device in session 26 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nxQhMPJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23737363034663135', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737363034663135', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1101039281',display_name='tempest-ServerStableDeviceRescueTest-server-1101039281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1101039281',id=17,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHebnVQS6FKvNF+wx3CgvjfoGurhBvBEYNi0m1NZpNycK+s9g88yhFnWyRIXs30QEGidB46jkt5hBj7CYDe5yZT8G0ZxFj/sDeK6FJM8iYWgXhKaUnWIJTU1oqWUd2vq5A==',key_name='tempest-keypair-899067751',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd4ea2ebbfce4ad3b2f94d34a0ecd9c9',ramdisk_id='',reservation_id='r-dzy4ans0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1897188969',owner_user_name='tempest-ServerStableDeviceRescueTest-1897188969-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e97d9f26d4b6581e3c8461b9b5590',uuid=48cc4550-2634-4291-a55b-e66338585160,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "vif_mac": "fa:16:3e:8e:61:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converting VIF {"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "vif_mac": "fa:16:3e:8e:61:19"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'pci_devices' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Object Instance<48cc4550-2634-4291-a55b-e66338585160> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:41:06 user nova-compute[75292]:   <uuid>48cc4550-2634-4291-a55b-e66338585160</uuid>
Nov 14 14:41:06 user nova-compute[75292]:   <name>instance-00000011</name>
Nov 14 14:41:06 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:41:06 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:41:06 user nova-compute[75292]:   <metadata>
Nov 14 14:41:06 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:06 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:41:06 user nova-compute[75292]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1101039281</nova:name>
Nov 14 14:41:06 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:41:06</nova:creationTime>
Nov 14 14:41:06 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:41:06 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:06 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:41:06 user nova-compute[75292]:       <nova:owner>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:user uuid="eb1e97d9f26d4b6581e3c8461b9b5590">tempest-ServerStableDeviceRescueTest-1897188969-project-member</nova:user>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:project uuid="dd4ea2ebbfce4ad3b2f94d34a0ecd9c9">tempest-ServerStableDeviceRescueTest-1897188969</nova:project>
Nov 14 14:41:06 user nova-compute[75292]:       </nova:owner>
Nov 14 14:41:06 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:06 user nova-compute[75292]:       <nova:ports>
Nov 14 14:41:06 user nova-compute[75292]:         <nova:port uuid="c1259aab-5d16-453a-9a2a-43fc1b982a07">
Nov 14 14:41:06 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:41:06 user nova-compute[75292]:         </nova:port>
Nov 14 14:41:06 user nova-compute[75292]:       </nova:ports>
Nov 14 14:41:06 user nova-compute[75292]:     </nova:instance>
Nov 14 14:41:06 user nova-compute[75292]:   </metadata>
Nov 14 14:41:06 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:41:06 user nova-compute[75292]:     <system>
Nov 14 14:41:06 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:41:06 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:41:06 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:41:06 user nova-compute[75292]:       <entry name="serial">48cc4550-2634-4291-a55b-e66338585160</entry>
Nov 14 14:41:06 user nova-compute[75292]:       <entry name="uuid">48cc4550-2634-4291-a55b-e66338585160</entry>
Nov 14 14:41:06 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:41:06 user nova-compute[75292]:     </system>
Nov 14 14:41:06 user nova-compute[75292]:   </sysinfo>
Nov 14 14:41:06 user nova-compute[75292]:   <os>
Nov 14 14:41:06 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:41:06 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:41:06 user nova-compute[75292]:   </os>
Nov 14 14:41:06 user nova-compute[75292]:   <features>
Nov 14 14:41:06 user nova-compute[75292]:     <acpi/>
Nov 14 14:41:06 user nova-compute[75292]:     <apic/>
Nov 14 14:41:06 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:41:06 user nova-compute[75292]:   </features>
Nov 14 14:41:06 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:41:06 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:41:06 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:41:06 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:41:06 user nova-compute[75292]:   </clock>
Nov 14 14:41:06 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:41:06 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:41:06 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:41:06 user nova-compute[75292]:   </cpu>
Nov 14 14:41:06 user nova-compute[75292]:   <devices>
Nov 14 14:41:06 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:41:06 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:41:06 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk"/>
Nov 14 14:41:06 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:41:06 user nova-compute[75292]:     </disk>
Nov 14 14:41:06 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:41:06 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:41:06 user nova-compute[75292]:       <source dev="/dev/sdd"/>
Nov 14 14:41:06 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:41:06 user nova-compute[75292]:       <serial>ace0a3c1-37ad-4bfe-b1b3-cdba59134c85</serial>
Nov 14 14:41:06 user nova-compute[75292]:     </disk>
Nov 14 14:41:06 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:41:06 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:41:06 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue"/>
Nov 14 14:41:06 user nova-compute[75292]:       <target dev="vdc" bus="virtio"/>
Nov 14 14:41:06 user nova-compute[75292]:       <boot order="1"/>
Nov 14 14:41:06 user nova-compute[75292]:     </disk>
Nov 14 14:41:06 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:41:06 user nova-compute[75292]:       <mac address="fa:16:3e:8e:61:19"/>
Nov 14 14:41:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:41:06 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:41:06 user nova-compute[75292]:       <target dev="tapc1259aab-5d"/>
Nov 14 14:41:06 user nova-compute[75292]:     </interface>
Nov 14 14:41:06 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:41:06 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/console.log" append="off"/>
Nov 14 14:41:06 user nova-compute[75292]:     </serial>
Nov 14 14:41:06 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:41:06 user nova-compute[75292]:     <video>
Nov 14 14:41:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:41:06 user nova-compute[75292]:     </video>
Nov 14 14:41:06 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:41:06 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:41:06 user nova-compute[75292]:     </rng>
Nov 14 14:41:06 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:41:06 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:41:06 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:41:06 user nova-compute[75292]:     </memballoon>
Nov 14 14:41:06 user nova-compute[75292]:   </devices>
Nov 14 14:41:06 user nova-compute[75292]: </domain>
Nov 14 14:41:06 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:41:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance destroyed successfully.
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] No VIF found with MAC fa:16:3e:8e:61:19, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:07 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Took 0.51 seconds to deallocate network for instance.
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-3e932737-9b09-4eb1-8dc4-b0c9446c1f73 req-74e601cc-44b2-4524-abc0-b47550a953ff service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received event network-vif-deleted-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:07 user nova-compute[75292]: INFO nova.compute.manager [req-3e932737-9b09-4eb1-8dc4-b0c9446c1f73 req-74e601cc-44b2-4524-abc0-b47550a953ff service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Neutron deleted interface 46a5a891-460f-4047-b85d-38ff7df38097; detaching it from the instance and deleting it from the info cache
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-3e932737-9b09-4eb1-8dc4-b0c9446c1f73 req-74e601cc-44b2-4524-abc0-b47550a953ff service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-3e932737-9b09-4eb1-8dc4-b0c9446c1f73 req-74e601cc-44b2-4524-abc0-b47550a953ff service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Detach interface failed, port_id=46a5a891-460f-4047-b85d-38ff7df38097, reason: Instance c483fca4-a13e-4a9c-957f-fe36ab5e3db7 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:07 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Deleted allocations for instance c483fca4-a13e-4a9c-957f-fe36ab5e3db7
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received event network-vif-unplugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] No waiting events found dispatching network-vif-unplugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:07 user nova-compute[75292]: WARNING nova.compute.manager [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received unexpected event network-vif-unplugged-46a5a891-460f-4047-b85d-38ff7df38097 for instance with vm_state deleted and task_state None.
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received event network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] Acquiring lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] No waiting events found dispatching network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:07 user nova-compute[75292]: WARNING nova.compute.manager [req-0c4b02eb-502d-4a7a-b430-2c7040118943 req-46f6ce15-6875-4f9d-ba03-0f2c4185b435 service nova] [instance: c483fca4-a13e-4a9c-957f-fe36ab5e3db7] Received unexpected event network-vif-plugged-46a5a891-460f-4047-b85d-38ff7df38097 for instance with vm_state deleted and task_state None.
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7b801e98-d4df-4bf3-8a1e-aa6dea249441 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c483fca4-a13e-4a9c-957f-fe36ab5e3db7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:09 user nova-compute[75292]: WARNING nova.compute.manager [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state active and task_state rescuing.
Nov 14 14:41:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:09 user nova-compute[75292]: WARNING nova.compute.manager [req-33eaa667-46eb-4df3-a5ad-8034b6ea5096 req-d22e8581-5a0c-45a3-a3aa-7fad82f007b0 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state active and task_state rescuing.
Nov 14 14:41:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-c32f77cf-364a-4c88-813d-7b7eea09e1ea tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:41:13 user nova-compute[75292]: INFO nova.compute.claims [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Claim successful on node user
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:41:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.policy [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38a8da6883ae40c4b12c8c483d598a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ef654d69c34328893549c7a124aebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:41:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Creating image(s)
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Successfully created port: 3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.654s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:14 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:14 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.257476806640625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f97410b4-b961-4b67-be80-49404e1849b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk 1073741824" returned: 0 in 0.068s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:41:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Successfully updated port: 3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Cannot resize image /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Ensure instance console log exists: /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-changed-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Refreshing instance network info cache due to event network-changed-3b668cf2-43b9-45cf-a99c-a98a74f0dff1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] Acquiring lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updating instance_info_cache with network_info: [{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Instance network_info: |[{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] Acquired lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Refreshing network info cache for port 3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Start _get_guest_xml network_info=[{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:41:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982198259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982198259',id=24,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-03pginpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:41:14Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=a8a94376-8ca1-4e3d-84b5-e597543f7ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.objects.instance [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'pci_devices' on Instance uuid a8a94376-8ca1-4e3d-84b5-e597543f7ce4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:41:15 user nova-compute[75292]:   <uuid>a8a94376-8ca1-4e3d-84b5-e597543f7ce4</uuid>
Nov 14 14:41:15 user nova-compute[75292]:   <name>instance-00000018</name>
Nov 14 14:41:15 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:41:15 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:41:15 user nova-compute[75292]:   <metadata>
Nov 14 14:41:15 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:15 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:41:15 user nova-compute[75292]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-982198259</nova:name>
Nov 14 14:41:15 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:41:15</nova:creationTime>
Nov 14 14:41:15 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:41:15 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:15 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:41:15 user nova-compute[75292]:       <nova:owner>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:user uuid="38a8da6883ae40c4b12c8c483d598a40">tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member</nova:user>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:project uuid="60ef654d69c34328893549c7a124aebf">tempest-ServerBootFromVolumeStableRescueTest-172724502</nova:project>
Nov 14 14:41:15 user nova-compute[75292]:       </nova:owner>
Nov 14 14:41:15 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:15 user nova-compute[75292]:       <nova:ports>
Nov 14 14:41:15 user nova-compute[75292]:         <nova:port uuid="3b668cf2-43b9-45cf-a99c-a98a74f0dff1">
Nov 14 14:41:15 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 14:41:15 user nova-compute[75292]:         </nova:port>
Nov 14 14:41:15 user nova-compute[75292]:       </nova:ports>
Nov 14 14:41:15 user nova-compute[75292]:     </nova:instance>
Nov 14 14:41:15 user nova-compute[75292]:   </metadata>
Nov 14 14:41:15 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:41:15 user nova-compute[75292]:     <system>
Nov 14 14:41:15 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:41:15 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:41:15 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:41:15 user nova-compute[75292]:       <entry name="serial">a8a94376-8ca1-4e3d-84b5-e597543f7ce4</entry>
Nov 14 14:41:15 user nova-compute[75292]:       <entry name="uuid">a8a94376-8ca1-4e3d-84b5-e597543f7ce4</entry>
Nov 14 14:41:15 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:41:15 user nova-compute[75292]:     </system>
Nov 14 14:41:15 user nova-compute[75292]:   </sysinfo>
Nov 14 14:41:15 user nova-compute[75292]:   <os>
Nov 14 14:41:15 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:41:15 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:41:15 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:41:15 user nova-compute[75292]:   </os>
Nov 14 14:41:15 user nova-compute[75292]:   <features>
Nov 14 14:41:15 user nova-compute[75292]:     <acpi/>
Nov 14 14:41:15 user nova-compute[75292]:     <apic/>
Nov 14 14:41:15 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:41:15 user nova-compute[75292]:   </features>
Nov 14 14:41:15 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:41:15 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:41:15 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:41:15 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:41:15 user nova-compute[75292]:   </clock>
Nov 14 14:41:15 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:41:15 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:41:15 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:41:15 user nova-compute[75292]:   </cpu>
Nov 14 14:41:15 user nova-compute[75292]:   <devices>
Nov 14 14:41:15 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:41:15 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:41:15 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk"/>
Nov 14 14:41:15 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:41:15 user nova-compute[75292]:     </disk>
Nov 14 14:41:15 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:41:15 user nova-compute[75292]:       <mac address="fa:16:3e:49:1b:d5"/>
Nov 14 14:41:15 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:41:15 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:41:15 user nova-compute[75292]:       <target dev="tap3b668cf2-43"/>
Nov 14 14:41:15 user nova-compute[75292]:     </interface>
Nov 14 14:41:15 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:41:15 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/console.log" append="off"/>
Nov 14 14:41:15 user nova-compute[75292]:     </serial>
Nov 14 14:41:15 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:41:15 user nova-compute[75292]:     <video>
Nov 14 14:41:15 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:41:15 user nova-compute[75292]:     </video>
Nov 14 14:41:15 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:41:15 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:41:15 user nova-compute[75292]:     </rng>
Nov 14 14:41:15 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:41:15 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:41:15 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:41:15 user nova-compute[75292]:     </memballoon>
Nov 14 14:41:15 user nova-compute[75292]:   </devices>
Nov 14 14:41:15 user nova-compute[75292]: </domain>
Nov 14 14:41:15 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982198259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982198259',id=24,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-03pginpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:41:14Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=a8a94376-8ca1-4e3d-84b5-e597543f7ce4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG os_vif [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b891e2bf-e70a-5604-9753-cb351a5fc2c9', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b668cf2-43, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b668cf2-43, col_values=(('qos', UUID('c381a2d1-867e-4883-9fd7-3d74d22fa032')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b668cf2-43, col_values=(('external_ids', {'iface-id': '3b668cf2-43b9-45cf-a99c-a98a74f0dff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:1b:d5', 'vm-uuid': 'a8a94376-8ca1-4e3d-84b5-e597543f7ce4'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:15 user nova-compute[75292]: INFO os_vif [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43')
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No VIF found with MAC fa:16:3e:49:1b:d5, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updated VIF entry in instance network info cache for port 3b668cf2-43b9-45cf-a99c-a98a74f0dff1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updating instance_info_cache with network_info: [{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff8c5939-c551-4a12-b5cc-c6c8811568c4 req-841aa80e-03c9-4166-b0d4-10484ee423cb service nova] Releasing lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:41:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-05fd8d9d-3f84-45db-ab08-9223e4e46a07 req-d33704f8-81dd-45dd-b18c-0bcad70cf790 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-05fd8d9d-3f84-45db-ab08-9223e4e46a07 req-d33704f8-81dd-45dd-b18c-0bcad70cf790 service nova] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-05fd8d9d-3f84-45db-ab08-9223e4e46a07 req-d33704f8-81dd-45dd-b18c-0bcad70cf790 service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-05fd8d9d-3f84-45db-ab08-9223e4e46a07 req-d33704f8-81dd-45dd-b18c-0bcad70cf790 service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-05fd8d9d-3f84-45db-ab08-9223e4e46a07 req-d33704f8-81dd-45dd-b18c-0bcad70cf790 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] No waiting events found dispatching network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:17 user nova-compute[75292]: WARNING nova.compute.manager [req-05fd8d9d-3f84-45db-ab08-9223e4e46a07 req-d33704f8-81dd-45dd-b18c-0bcad70cf790 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received unexpected event network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 for instance with vm_state building and task_state spawning.
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:41:19 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Instance spawned successfully.
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-b5be6d03-a884-4984-adb3-65b1aa0c01be req-3e333e36-8e00-4df2-a399-2fb08544109e service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5be6d03-a884-4984-adb3-65b1aa0c01be req-3e333e36-8e00-4df2-a399-2fb08544109e service nova] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5be6d03-a884-4984-adb3-65b1aa0c01be req-3e333e36-8e00-4df2-a399-2fb08544109e service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5be6d03-a884-4984-adb3-65b1aa0c01be req-3e333e36-8e00-4df2-a399-2fb08544109e service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-b5be6d03-a884-4984-adb3-65b1aa0c01be req-3e333e36-8e00-4df2-a399-2fb08544109e service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] No waiting events found dispatching network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:19 user nova-compute[75292]: WARNING nova.compute.manager [req-b5be6d03-a884-4984-adb3-65b1aa0c01be req-3e333e36-8e00-4df2-a399-2fb08544109e service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received unexpected event network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 for instance with vm_state building and task_state spawning.
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:19 user nova-compute[75292]: INFO nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 14 14:41:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:41:19 user nova-compute[75292]: INFO nova.compute.manager [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Took 6.71 seconds to build instance.
Nov 14 14:41:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-90bf1aec-a15d-4cb6-a57f-ead4d4956641 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.888s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:32 user nova-compute[75292]: INFO nova.compute.manager [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Terminating instance
Nov 14 14:41:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-01463943-9d7d-497a-8f92-83a3869fd2c2 req-58a3ac90-86f8-4df9-a8bf-01fa5b336ad4 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-unplugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01463943-9d7d-497a-8f92-83a3869fd2c2 req-58a3ac90-86f8-4df9-a8bf-01fa5b336ad4 service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01463943-9d7d-497a-8f92-83a3869fd2c2 req-58a3ac90-86f8-4df9-a8bf-01fa5b336ad4 service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-01463943-9d7d-497a-8f92-83a3869fd2c2 req-58a3ac90-86f8-4df9-a8bf-01fa5b336ad4 service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-01463943-9d7d-497a-8f92-83a3869fd2c2 req-58a3ac90-86f8-4df9-a8bf-01fa5b336ad4 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-unplugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-01463943-9d7d-497a-8f92-83a3869fd2c2 req-58a3ac90-86f8-4df9-a8bf-01fa5b336ad4 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-unplugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:41:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Instance destroyed successfully.
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lazy-loading 'resources' on Instance uuid 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T14:38:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-798006360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-798006360',id=21,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9bBhESoLh29gqVMy5xUdEYY5vIq7XhU6FnglJUzXiEZ+w7Wjz5wfZ69AwWRMoTwG6908C/4NVOfzplnngN9wvlltc/p14PinHh0lTvBsicAgOto/j4XdNzVLNU2eXXbg==',key_name='tempest-keypair-1752218743',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed7f4b849d66445b847310e31ebb139e',ramdisk_id='',reservation_id='r-v4l50m9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1397313175',owner_user_name='tempest-TaggedAttachmentsTest-1397313175-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:38:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f9145d6e9f947d78220d587fe76fa99',uuid=6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converting VIF {"id": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "address": "fa:16:3e:0c:00:22", "network": {"id": "e009245d-8647-4641-aa45-c9552f812761", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-345182119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed7f4b849d66445b847310e31ebb139e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa34295b5-1a", "ovs_interfaceid": "a34295b5-1ac7-44b4-b7a6-1a0a12232f5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG os_vif [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa34295b5-1a, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=055cf80f-ae9b-44c2-be83-c703b2dcb5ee) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:33 user nova-compute[75292]: INFO os_vif [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:00:22,bridge_name='br-int',has_traffic_filtering=True,id=a34295b5-1ac7-44b4-b7a6-1a0a12232f5c,network=Network(e009245d-8647-4641-aa45-c9552f812761),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa34295b5-1a')
Nov 14 14:41:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Deleting instance files /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438_del
Nov 14 14:41:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Deletion of /opt/stack/data/nova/instances/6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438_del complete
Nov 14 14:41:33 user nova-compute[75292]: INFO nova.compute.manager [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 14:41:33 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:41:33 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:34 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Took 0.95 seconds to deallocate network for instance.
Nov 14 14:41:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG nova.compute.manager [req-c98a6dbe-12f8-4484-8156-ffb3e873c543 req-f19d14d5-09ea-47d7-8380-61e262162fa4 service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-deleted-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:41:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:35 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Deleted allocations for instance 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438
Nov 14 14:41:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7e2ddb8-1e34-4d38-b1b4-8aa58bf86f05 tempest-TaggedAttachmentsTest-1397313175 tempest-TaggedAttachmentsTest-1397313175-project-member] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-c0cf06ad-20c2-41a4-819e-87456eb62759 req-25f498c8-3a82-4bc5-8673-1e6fe82bfc6a service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received event network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c0cf06ad-20c2-41a4-819e-87456eb62759 req-25f498c8-3a82-4bc5-8673-1e6fe82bfc6a service nova] Acquiring lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c0cf06ad-20c2-41a4-819e-87456eb62759 req-25f498c8-3a82-4bc5-8673-1e6fe82bfc6a service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c0cf06ad-20c2-41a4-819e-87456eb62759 req-25f498c8-3a82-4bc5-8673-1e6fe82bfc6a service nova] Lock "6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-c0cf06ad-20c2-41a4-819e-87456eb62759 req-25f498c8-3a82-4bc5-8673-1e6fe82bfc6a service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] No waiting events found dispatching network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:35 user nova-compute[75292]: WARNING nova.compute.manager [req-c0cf06ad-20c2-41a4-819e-87456eb62759 req-25f498c8-3a82-4bc5-8673-1e6fe82bfc6a service nova] [instance: 6e57a8cd-25c0-48dd-bfb6-ef5a1bd44438] Received unexpected event network-vif-plugged-a34295b5-1ac7-44b4-b7a6-1a0a12232f5c for instance with vm_state deleted and task_state None.
Nov 14 14:41:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:41:40 user nova-compute[75292]: INFO nova.compute.claims [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Claim successful on node user
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:41:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.policy [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9970be0d6d0a4c7193237192da054e8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '850c4eb7326f46c59998de50b99686c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:41:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Creating image(s)
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk 1073741824" returned: 0 in 0.047s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Successfully created port: b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Cannot resize image /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Ensure instance console log exists: /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Successfully updated port: b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing instance network info cache due to event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:41:41 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance network_info: |[{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.neutron [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Start _get_guest_xml network_info=[{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:41:42 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:42 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-114219581',display_name='tempest-ServerRescueNegativeTestJSON-server-114219581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-114219581',id=25,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtjnRl1Ks4Lpj+FP0MXNTlSFtMOyGZjsfkyZzWmXWa4qP8BIQlnb97O1Nz2V70smYhF6KnmlAD+18T86hqfoM6IUejgcYHG0amcmcYJ2L9mekZvZGh25+reH/cSjEyXDQ==',key_name='tempest-keypair-1120055896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-tmfjgu0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9970be0d6d0a4c7193237192da054e8c',uuid=a7678b53-9d02-4504-97a5-8a92be22318c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'pci_devices' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:41:42 user nova-compute[75292]:   <uuid>a7678b53-9d02-4504-97a5-8a92be22318c</uuid>
Nov 14 14:41:42 user nova-compute[75292]:   <name>instance-00000019</name>
Nov 14 14:41:42 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:41:42 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:41:42 user nova-compute[75292]:   <metadata>
Nov 14 14:41:42 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:41:42 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:41:42 user nova-compute[75292]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-114219581</nova:name>
Nov 14 14:41:42 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:41:42</nova:creationTime>
Nov 14 14:41:42 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:41:42 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:41:42 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:41:42 user nova-compute[75292]:       <nova:owner>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:user uuid="9970be0d6d0a4c7193237192da054e8c">tempest-ServerRescueNegativeTestJSON-1737174677-project-member</nova:user>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:project uuid="850c4eb7326f46c59998de50b99686c0">tempest-ServerRescueNegativeTestJSON-1737174677</nova:project>
Nov 14 14:41:42 user nova-compute[75292]:       </nova:owner>
Nov 14 14:41:42 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:41:42 user nova-compute[75292]:       <nova:ports>
Nov 14 14:41:42 user nova-compute[75292]:         <nova:port uuid="b5bee998-bef9-45ef-9249-7c33330c9960">
Nov 14 14:41:42 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:41:42 user nova-compute[75292]:         </nova:port>
Nov 14 14:41:42 user nova-compute[75292]:       </nova:ports>
Nov 14 14:41:42 user nova-compute[75292]:     </nova:instance>
Nov 14 14:41:42 user nova-compute[75292]:   </metadata>
Nov 14 14:41:42 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:41:42 user nova-compute[75292]:     <system>
Nov 14 14:41:42 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:41:42 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:41:42 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:41:42 user nova-compute[75292]:       <entry name="serial">a7678b53-9d02-4504-97a5-8a92be22318c</entry>
Nov 14 14:41:42 user nova-compute[75292]:       <entry name="uuid">a7678b53-9d02-4504-97a5-8a92be22318c</entry>
Nov 14 14:41:42 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:41:42 user nova-compute[75292]:     </system>
Nov 14 14:41:42 user nova-compute[75292]:   </sysinfo>
Nov 14 14:41:42 user nova-compute[75292]:   <os>
Nov 14 14:41:42 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:41:42 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:41:42 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:41:42 user nova-compute[75292]:   </os>
Nov 14 14:41:42 user nova-compute[75292]:   <features>
Nov 14 14:41:42 user nova-compute[75292]:     <acpi/>
Nov 14 14:41:42 user nova-compute[75292]:     <apic/>
Nov 14 14:41:42 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:41:42 user nova-compute[75292]:   </features>
Nov 14 14:41:42 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:41:42 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:41:42 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:41:42 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:41:42 user nova-compute[75292]:   </clock>
Nov 14 14:41:42 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:41:42 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:41:42 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:41:42 user nova-compute[75292]:   </cpu>
Nov 14 14:41:42 user nova-compute[75292]:   <devices>
Nov 14 14:41:42 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:41:42 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:41:42 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk"/>
Nov 14 14:41:42 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:41:42 user nova-compute[75292]:     </disk>
Nov 14 14:41:42 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:41:42 user nova-compute[75292]:       <mac address="fa:16:3e:ff:7b:57"/>
Nov 14 14:41:42 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:41:42 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:41:42 user nova-compute[75292]:       <target dev="tapb5bee998-be"/>
Nov 14 14:41:42 user nova-compute[75292]:     </interface>
Nov 14 14:41:42 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:41:42 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/console.log" append="off"/>
Nov 14 14:41:42 user nova-compute[75292]:     </serial>
Nov 14 14:41:42 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:41:42 user nova-compute[75292]:     <video>
Nov 14 14:41:42 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:41:42 user nova-compute[75292]:     </video>
Nov 14 14:41:42 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:41:42 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:41:42 user nova-compute[75292]:     </rng>
Nov 14 14:41:42 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:41:42 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:41:42 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:41:42 user nova-compute[75292]:     </memballoon>
Nov 14 14:41:42 user nova-compute[75292]:   </devices>
Nov 14 14:41:42 user nova-compute[75292]: </domain>
Nov 14 14:41:42 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-114219581',display_name='tempest-ServerRescueNegativeTestJSON-server-114219581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-114219581',id=25,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtjnRl1Ks4Lpj+FP0MXNTlSFtMOyGZjsfkyZzWmXWa4qP8BIQlnb97O1Nz2V70smYhF6KnmlAD+18T86hqfoM6IUejgcYHG0amcmcYJ2L9mekZvZGh25+reH/cSjEyXDQ==',key_name='tempest-keypair-1120055896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-tmfjgu0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:41:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9970be0d6d0a4c7193237192da054e8c',uuid=a7678b53-9d02-4504-97a5-8a92be22318c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG os_vif [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b0fcfb2-984d-58b2-bdb8-03b3383ba555', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5bee998-be, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5bee998-be, col_values=(('qos', UUID('b388724c-2191-4805-9a9f-afbd742da5f5')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5bee998-be, col_values=(('external_ids', {'iface-id': 'b5bee998-bef9-45ef-9249-7c33330c9960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:7b:57', 'vm-uuid': 'a7678b53-9d02-4504-97a5-8a92be22318c'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:42 user nova-compute[75292]: INFO os_vif [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be')
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:ff:7b:57, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.neutron [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updated VIF entry in instance network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG nova.network.neutron [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6534c83b-7e39-4347-b8ea-bd8617973bbd req-68242c8c-6d54-47c2-970e-b0bf0f825fe1 service nova] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-4157700a-3e20-48bc-a22a-62a31bea7d58 req-cdaf888d-dbf3-4fb3-8db8-c2a566012823 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4157700a-3e20-48bc-a22a-62a31bea7d58 req-cdaf888d-dbf3-4fb3-8db8-c2a566012823 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4157700a-3e20-48bc-a22a-62a31bea7d58 req-cdaf888d-dbf3-4fb3-8db8-c2a566012823 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4157700a-3e20-48bc-a22a-62a31bea7d58 req-cdaf888d-dbf3-4fb3-8db8-c2a566012823 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-4157700a-3e20-48bc-a22a-62a31bea7d58 req-cdaf888d-dbf3-4fb3-8db8-c2a566012823 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:43 user nova-compute[75292]: WARNING nova.compute.manager [req-4157700a-3e20-48bc-a22a-62a31bea7d58 req-cdaf888d-dbf3-4fb3-8db8-c2a566012823 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state building and task_state spawning.
Nov 14 14:41:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:41:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance spawned successfully.
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:41:45 user nova-compute[75292]: INFO nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 14 14:41:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:41:45 user nova-compute[75292]: INFO nova.compute.manager [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Took 5.83 seconds to build instance.
Nov 14 14:41:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4b459578-29ad-4d45-8d09-e5c1e52ddfd5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.970s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-6bf15c22-df74-4a4c-a5a0-230186d6278b req-70685fa6-e845-469a-919b-64bb1c4f64f6 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6bf15c22-df74-4a4c-a5a0-230186d6278b req-70685fa6-e845-469a-919b-64bb1c4f64f6 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6bf15c22-df74-4a4c-a5a0-230186d6278b req-70685fa6-e845-469a-919b-64bb1c4f64f6 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6bf15c22-df74-4a4c-a5a0-230186d6278b req-70685fa6-e845-469a-919b-64bb1c4f64f6 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-6bf15c22-df74-4a4c-a5a0-230186d6278b req-70685fa6-e845-469a-919b-64bb1c4f64f6 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:46 user nova-compute[75292]: WARNING nova.compute.manager [req-6bf15c22-df74-4a4c-a5a0-230186d6278b req-70685fa6-e845-469a-919b-64bb1c4f64f6 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state active and task_state None.
Nov 14 14:41:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:48 user nova-compute[75292]: INFO nova.compute.manager [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Terminating instance
Nov 14 14:41:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-c04fdae0-cdf4-4356-aca3-3fef2c3011d4 req-d95e2213-b181-4e41-8af2-84d333dbcb8f service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c04fdae0-cdf4-4356-aca3-3fef2c3011d4 req-d95e2213-b181-4e41-8af2-84d333dbcb8f service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c04fdae0-cdf4-4356-aca3-3fef2c3011d4 req-d95e2213-b181-4e41-8af2-84d333dbcb8f service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c04fdae0-cdf4-4356-aca3-3fef2c3011d4 req-d95e2213-b181-4e41-8af2-84d333dbcb8f service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-c04fdae0-cdf4-4356-aca3-3fef2c3011d4 req-d95e2213-b181-4e41-8af2-84d333dbcb8f service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-c04fdae0-cdf4-4356-aca3-3fef2c3011d4 req-d95e2213-b181-4e41-8af2-84d333dbcb8f service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-unplugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Instance destroyed successfully.
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.objects.instance [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lazy-loading 'resources' on Instance uuid c5ce2080-b527-4c87-b422-6de3f2d0c4d7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2014877484',display_name='tempest-ServerActionsTestOtherB-server-2014877484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2014877484',id=2,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0G6imRDBUMsB7LKl4ozlilKMBgmEZsh5jvBqo6gRKMbhQu1QbUKmg8o0T4D0IMI0LlkMScFIirX9yRlDEmVcAodNgaIGuwoVoJDERZMNIjWLEsaOIHHwFHEl8UhRgR4w==',key_name='tempest-keypair-349716745',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:39:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34612ba41d07410b8d6f934e759f0073',ramdisk_id='',reservation_id='r-0icmmp3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1910038092',owner_user_name='tempest-ServerActionsTestOtherB-1910038092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44e3e41e693f47bdae15a362ba3d5344',uuid=c5ce2080-b527-4c87-b422-6de3f2d0c4d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converting VIF {"id": "681ed373-e78f-4440-9658-ae5f20726f63", "address": "fa:16:3e:73:d7:5d", "network": {"id": "a9cdbf31-0665-438d-9734-5af5af150d7f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1770419626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34612ba41d07410b8d6f934e759f0073", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap681ed373-e7", "ovs_interfaceid": "681ed373-e78f-4440-9658-ae5f20726f63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_vif [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap681ed373-e7, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f2204f6-495c-4f02-861f-d18be27d29fd) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:49 user nova-compute[75292]: INFO os_vif [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:d7:5d,bridge_name='br-int',has_traffic_filtering=True,id=681ed373-e78f-4440-9658-ae5f20726f63,network=Network(a9cdbf31-0665-438d-9734-5af5af150d7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap681ed373-e7')
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSuPnEzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:41:49 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f36ee-589a-45d4-97ea-67365622c974]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:41:49 user nova-compute[75292]: No targets found.
Nov 14 14:41:49 user nova-compute[75292]: iSNS:
Nov 14 14:41:49 user nova-compute[75292]: No targets found.
Nov 14 14:41:49 user nova-compute[75292]: STATIC:
Nov 14 14:41:49 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:41:49 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:41:49 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:41:49 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:41:49 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:41:49 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:41:49 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:41:49 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:41:49 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:41:49 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35
Nov 14 14:41:49 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:41:49 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:41:49 user nova-compute[75292]: FIRMWARE:
Nov 14 14:41:49 user nova-compute[75292]: No targets found.
Nov 14 14:41:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:41:49 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:41:49 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[430143fc-93f6-4b7f-96d1-3d198e31680d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[67311eac-e030-4310-9fcb-d41c16f36967]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:41:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5463fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4885ef0f-d0c7-4fa2-b298-dcb42dc5067d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[423ade2f-ef5f-4a00-82f0-9fbfbe09f4c7]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[97414763-b7af-4a81-bce5-4d1de42c2031]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4b4139-54a7-49e2-b137-7cead6576764]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3292145a-6d26-4e9e-aa5b-1d4225f7d3a6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5090357-ad89-4c55-b111-9fd3627ae2fe]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260]
Nov 14 14:41:49 user nova-compute[75292]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35, portal: 172.16.0.220,3260] successful.
Nov 14 14:41:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4512e466-37fd-4d88-9657-b502c397bd35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f652d0-f82c-4bea-82a1-dfa0f6bed235]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] <== disconnect_volume: return (324ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:41:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Deleting instance files /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7_del
Nov 14 14:41:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Deletion of /opt/stack/data/nova/instances/c5ce2080-b527-4c87-b422-6de3f2d0c4d7_del complete
Nov 14 14:41:49 user nova-compute[75292]: INFO nova.compute.manager [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 14:41:49 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:41:50 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Took 1.11 seconds to deallocate network for instance.
Nov 14 14:41:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-11304b3e-c54c-41cf-b15e-42804bb1ac24 req-a03b2a4b-7f3b-45b8-ac1f-a4cbcebd93d9 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-deleted-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-150ee78b-eab1-487e-89db-8b44b6e253dd req-6a066517-57f8-45ac-a674-1bd23f80f635 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-150ee78b-eab1-487e-89db-8b44b6e253dd req-6a066517-57f8-45ac-a674-1bd23f80f635 service nova] Acquiring lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-150ee78b-eab1-487e-89db-8b44b6e253dd req-6a066517-57f8-45ac-a674-1bd23f80f635 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-150ee78b-eab1-487e-89db-8b44b6e253dd req-6a066517-57f8-45ac-a674-1bd23f80f635 service nova] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-150ee78b-eab1-487e-89db-8b44b6e253dd req-6a066517-57f8-45ac-a674-1bd23f80f635 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] No waiting events found dispatching network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:41:50 user nova-compute[75292]: WARNING nova.compute.manager [req-150ee78b-eab1-487e-89db-8b44b6e253dd req-6a066517-57f8-45ac-a674-1bd23f80f635 service nova] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Received unexpected event network-vif-plugged-681ed373-e78f-4440-9658-ae5f20726f63 for instance with vm_state active and task_state deleting.
Nov 14 14:41:51 user nova-compute[75292]: INFO nova.compute.manager [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] [instance: c5ce2080-b527-4c87-b422-6de3f2d0c4d7] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 14:41:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:51 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:41:51 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:41:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:52 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Deleted allocations for instance c5ce2080-b527-4c87-b422-6de3f2d0c4d7
Nov 14 14:41:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-888fddb0-fe0e-4573-a3e4-2f937ff6b2c2 tempest-ServerActionsTestOtherB-1910038092 tempest-ServerActionsTestOtherB-1910038092-project-member] Lock "c5ce2080-b527-4c87-b422-6de3f2d0c4d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.608s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:41:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:41:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:41:54 user nova-compute[75292]: INFO nova.compute.manager [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Detaching volume 5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:41:54 user nova-compute[75292]: INFO nova.virt.block_device [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Attempting to driver detach volume 5050e2c4-4afb-4656-a981-27b11bd94664 from mountpoint /dev/vdb
Nov 14 14:41:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Attempting to detach device vdb from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:41:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:41:54 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:41:54 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:41:54 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:41:54 user nova-compute[75292]:   <serial>5050e2c4-4afb-4656-a981-27b11bd94664</serial>
Nov 14 14:41:54 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 14:41:54 user nova-compute[75292]: </disk>
Nov 14 14:41:54 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:41:54 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully detached device vdb from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 from the persistent domain config.
Nov 14 14:41:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:41:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:41:54 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:41:54 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:41:54 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:41:54 user nova-compute[75292]:   <serial>5050e2c4-4afb-4656-a981-27b11bd94664</serial>
Nov 14 14:41:54 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 14:41:54 user nova-compute[75292]: </disk>
Nov 14 14:41:54 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:41:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:41:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:42:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:42:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:42:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:08 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing instance network info cache due to event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG nova.network.neutron [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:42:13 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:42:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7444MB free_disk=25.24488067626953GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f97410b4-b961-4b67-be80-49404e1849b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a7678b53-9d02-4504-97a5-8a92be22318c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updated VIF entry in instance network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:14 user nova-compute[75292]: INFO nova.compute.manager [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Detaching volume 50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:42:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a75aedd-63bc-45de-9761-5310b8f22d51 req-8bfbe097-4a70-4e87-a830-781aad62893e service nova] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:14 user nova-compute[75292]: INFO nova.virt.block_device [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Attempting to driver detach volume 50f9263a-8520-4dc4-8601-b7b181497488 from mountpoint /dev/vdb
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Attempting to detach device vdb from instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:42:14 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:14 user nova-compute[75292]:   <source dev="/dev/sde"/>
Nov 14 14:42:14 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:42:14 user nova-compute[75292]:   <serial>50f9263a-8520-4dc4-8601-b7b181497488</serial>
Nov 14 14:42:14 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 14:42:14 user nova-compute[75292]: </disk>
Nov 14 14:42:14 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:42:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully detached device vdb from instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 from the persistent domain config.
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:42:14 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:14 user nova-compute[75292]:   <source dev="/dev/sde"/>
Nov 14 14:42:14 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:42:14 user nova-compute[75292]:   <serial>50f9263a-8520-4dc4-8601-b7b181497488</serial>
Nov 14 14:42:14 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 14:42:14 user nova-compute[75292]: </disk>
Nov 14 14:42:14 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:42:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing instance network info cache due to event network-changed-fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] Acquiring lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] Acquired lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Refreshing network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:42:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 is timed out.
Nov 14 14:42:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully detached device vdb from instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 from the live domain config.
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUWrVhot', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:15 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4abc66c-2f6f-4819-b381-4c1c6179e4b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:42:15 user nova-compute[75292]: No targets found.
Nov 14 14:42:15 user nova-compute[75292]: iSNS:
Nov 14 14:42:15 user nova-compute[75292]: No targets found.
Nov 14 14:42:15 user nova-compute[75292]: STATIC:
Nov 14 14:42:15 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:42:15 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:15 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:15 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:42:15 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:15 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:15 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664
Nov 14 14:42:15 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:15 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:15 user nova-compute[75292]: FIRMWARE:
Nov 14 14:42:15 user nova-compute[75292]: No targets found.
Nov 14 14:42:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:42:15 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:42:15 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46be139-3ee4-48c5-af8e-c3e2bf4a5931]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f02af-c9dd-45e1-be28-cbebfa0e3cb7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:42:15 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:15 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 (non-flash)
Nov 14 14:42:15 user nova-compute[75292]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:15 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b74146440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6194083-4432-4897-a79d-01d58d5745f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ce75c-73c3-4c0e-863e-7f4befeaef8f]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[008d8a6e-933f-4ec2-b88c-3756d217bb7e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4de91-09b6-42e0-abb3-55ff7c82b294]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5cbbe6-e55f-4f49-9da8-21cc6ef191a3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d58ddba-46cc-4bae-a6f6-77ed4b3a3d25]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260]
Nov 14 14:42:15 user nova-compute[75292]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664, portal: 172.16.0.220,3260] successful.
Nov 14 14:42:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5050e2c4-4afb-4656-a981-27b11bd94664 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b501c1ab-4479-42e5-8921-aed3c729687e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== disconnect_volume: return (277ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updated VIF entry in instance network info cache for port fea62a5d-74a2-4285-80fc-85b092e61f1a. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [{"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-59484441-ae0f-494e-963c-c0fa1347017e req-e8dc24db-4bcd-445e-bb7c-d7c0734fe02a service nova] Releasing lock "refresh_cache-7397dbe8-471b-40b2-8dea-cc8078a92a77" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:42:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'flavor' on Instance uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8ab4745-6a25-4a2c-b06d-7e13c55714a3 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-changed-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Refreshing instance network info cache due to event network-changed-53a879f8-37fd-432d-900f-44d9ab80fcf8. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:42:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] Acquiring lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] Acquired lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:17 user nova-compute[75292]: DEBUG nova.network.neutron [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Refreshing network info cache for port 53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updated VIF entry in instance network info cache for port 53a879f8-37fd-432d-900f-44d9ab80fcf8. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updating instance_info_cache with network_info: [{"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d15d2d5f-450e-4a38-b6c8-18d1691b6f1b req-308b8781-1afc-4588-8bfe-ac0af990c618 service nova] Releasing lock "refresh_cache-f97410b4-b961-4b67-be80-49404e1849b2" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'flavor' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:18 user nova-compute[75292]: INFO nova.compute.manager [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attaching volume 81e4711a-491b-43ff-809b-f7a51dfcb093 to /dev/vdb
Nov 14 14:42:18 user nova-compute[75292]: DEBUG os_brick.utils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e410d38-e000-4b53-a2eb-5dd33f840056]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ed291-7102-4e75-a413-74fdf0f98e42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[29107ce0-e531-45aa-8c61-cd539f4f1d44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1599e2da-5336-46d0-a55e-a6fe1b2f18aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:42:18 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:42:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[31273478-398c-4d72-b0c3-fbf3ec0be0c2]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG os_brick.utils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:18 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updating existing volume attachment record: 60346920-44f9-4f9e-852e-3ad0322f7175 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:42:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVaYAFML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:23 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25f9876-fb19-496e-a62d-023ff6c1086e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:42:23 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e77211-6fd2-445b-8a47-715eb3b753ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093] added
Nov 14 14:42:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a366e1-176e-4b36-9cfc-4177a3da7f88]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f482e0-ffd5-440f-b3c6-038eb8e42688]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVaYAFML {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVaYAFML" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9efdc71-5355-40c8-8a6c-884cb254a0b7]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVaYAFML'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b1b98-26d2-4b41-8aa7-e4529a5413eb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593d0b6-7e29-47ec-8b08-f07dfca8cc3b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c55678e-51ab-4a5b-9d23-63e6d69656db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260]
Nov 14 14:42:23 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260] successful.
Nov 14 14:42:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a504236-a4d1-4650-b96d-ac98ddd65f40]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9effd1ad-39fd-42bb-97c0-1a162f215c26]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bbd93a-1527-4ea5-b638-2a008ac5c28a]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:42:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVaYAFML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23963333436313139', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963333436313139', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG nova.objects.instance [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'flavor' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:42:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:42:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:42:24 user nova-compute[75292]:   <serial>81e4711a-491b-43ff-809b-f7a51dfcb093</serial>
Nov 14 14:42:24 user nova-compute[75292]: </disk>
Nov 14 14:42:24 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:42:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No VIF found with MAC fa:16:3e:71:d2:d1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:42:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43ddd464-6491-44c8-af41-7be5454d93b7 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.428s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'flavor' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:28 user nova-compute[75292]: INFO nova.compute.manager [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attaching volume 244f7874-f342-4afa-9dd4-368436a6fda0 to /dev/vdc
Nov 14 14:42:28 user nova-compute[75292]: DEBUG os_brick.utils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9876760b-c464-4664-af3c-bef35b7841a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17513d52-30b2-4701-af04-8e06595d62a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20876f98-059b-43d8-9201-cb12cd82321c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8d9ec1-a254-4fba-851d-1fa288228fac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:42:28 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:42:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e404b119-6e05-448f-bfd4-f8e9b0cc1a96]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG os_brick.utils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:28 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updating existing volume attachment record: 421def84-1dfb-4985-9467-ebbd376483ac {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:42:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXLIaumr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:33 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:33 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:33 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db71c64d-a4f7-463b-b579-b6dfe1e7ce6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:42:33 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[739350bf-66ba-43ac-b0f1-787df112a473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0] added
Nov 14 14:42:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba625495-5f25-4a09-a089-2a299a7d78c0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7db0e7-18a3-4e0f-bb40-1f7f3461a172]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXLIaumr {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXLIaumr" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe9dc43-3e60-472f-8bb9-82c262ba7ab0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXLIaumr'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b5d938-1423-4178-aebc-6640611f38cd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[66338ac6-0897-4289-b6ac-d014c69a4136]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea04e1a8-95bb-4751-bdc2-81aed797b3dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260]
Nov 14 14:42:33 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260] successful.
Nov 14 14:42:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0837918-9bdf-46dd-a0c0-726dd4650f90]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2faff17c-73cc-45cb-bdeb-fad843d311fd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b43ef7-8c29-49c4-b9e7-325cff2bb7aa]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:42:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXLIaumr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26531326432393264', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531326432393264', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'flavor' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:42:34 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:34 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:42:34 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 14:42:34 user nova-compute[75292]:   <serial>244f7874-f342-4afa-9dd4-368436a6fda0</serial>
Nov 14 14:42:34 user nova-compute[75292]: </disk>
Nov 14 14:42:34 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:42:34 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 is timed out.
Nov 14 14:42:34 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully detached device vdb from instance 7397dbe8-471b-40b2-8dea-cc8078a92a77 from the live domain config.
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rSAyUDgC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:34 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace94ca6-4d6d-4f74-a940-9538e9d82491]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:42:34 user nova-compute[75292]: No targets found.
Nov 14 14:42:34 user nova-compute[75292]: iSNS:
Nov 14 14:42:34 user nova-compute[75292]: No targets found.
Nov 14 14:42:34 user nova-compute[75292]: STATIC:
Nov 14 14:42:34 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488
Nov 14 14:42:34 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:34 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:34 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0
Nov 14 14:42:34 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:34 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:34 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:42:34 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:34 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:34 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093
Nov 14 14:42:34 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:34 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:34 user nova-compute[75292]: FIRMWARE:
Nov 14 14:42:34 user nova-compute[75292]: No targets found.
Nov 14 14:42:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:42:34 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:42:34 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d9fcce-3ccb-4223-a53c-607898fc0290]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6410498b-87da-4efb-a663-da784c81a1cf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5412e5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[703da236-a4f8-4ff5-9816-67eda8d4b038]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3affda-a292-4fce-af97-dd623cbc5e03]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cfd43b-5b2a-4107-a8b7-51d56317bbfb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[24212275-b0ba-4726-852b-93e73c2f6c5e]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[335f8da4-ba42-4936-8189-cf47791e710e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23308e6-93de-4c37-a107-5c2055726e85]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260]
Nov 14 14:42:34 user nova-compute[75292]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488, portal: 172.16.0.220,3260] successful.
Nov 14 14:42:34 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] No VIF found with MAC fa:16:3e:71:d2:d1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50f9263a-8520-4dc4-8601-b7b181497488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[70054594-3577-4b40-8a51-7bca99e79fdb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== disconnect_volume: return (339ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:42:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2c9c4958-3ebe-41d3-be07-3ccc485c9990 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.486s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:35 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'flavor' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1826fa61-cad6-4637-b73d-4446a55a1d30 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.647s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:36 user nova-compute[75292]: INFO nova.compute.manager [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Detaching volume 244f7874-f342-4afa-9dd4-368436a6fda0
Nov 14 14:42:36 user nova-compute[75292]: INFO nova.virt.block_device [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attempting to driver detach volume 244f7874-f342-4afa-9dd4-368436a6fda0 from mountpoint /dev/vdc
Nov 14 14:42:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Attempting to detach device vdc from instance f97410b4-b961-4b67-be80-49404e1849b2 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:42:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:42:36 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:36 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:42:36 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 14:42:36 user nova-compute[75292]:   <serial>244f7874-f342-4afa-9dd4-368436a6fda0</serial>
Nov 14 14:42:36 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 14:42:36 user nova-compute[75292]: </disk>
Nov 14 14:42:36 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:42:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Successfully detached device vdc from instance f97410b4-b961-4b67-be80-49404e1849b2 from the persistent domain config.
Nov 14 14:42:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f97410b4-b961-4b67-be80-49404e1849b2 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:42:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:42:36 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:36 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:42:36 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 14:42:36 user nova-compute[75292]:   <serial>244f7874-f342-4afa-9dd4-368436a6fda0</serial>
Nov 14 14:42:36 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 14:42:36 user nova-compute[75292]: </disk>
Nov 14 14:42:36 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:42:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:42:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:45 user nova-compute[75292]: INFO nova.compute.manager [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Terminating instance
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-9abd69d7-8fe5-427f-abb9-7b09b181cf6f req-a77d26c4-55c1-47ee-aee4-bb3311dcbdc3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-unplugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9abd69d7-8fe5-427f-abb9-7b09b181cf6f req-a77d26c4-55c1-47ee-aee4-bb3311dcbdc3 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9abd69d7-8fe5-427f-abb9-7b09b181cf6f req-a77d26c4-55c1-47ee-aee4-bb3311dcbdc3 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9abd69d7-8fe5-427f-abb9-7b09b181cf6f req-a77d26c4-55c1-47ee-aee4-bb3311dcbdc3 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-9abd69d7-8fe5-427f-abb9-7b09b181cf6f req-a77d26c4-55c1-47ee-aee4-bb3311dcbdc3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-unplugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-9abd69d7-8fe5-427f-abb9-7b09b181cf6f req-a77d26c4-55c1-47ee-aee4-bb3311dcbdc3 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-unplugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:42:45 user nova-compute[75292]: INFO nova.compute.claims [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Claim successful on node user
Nov 14 14:42:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Instance destroyed successfully.
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'resources' on Instance uuid e153ead2-1bf6-410b-9b0a-3c1bef1f8062 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-935294165',display_name='tempest-ServerActionsTestOtherA-server-1304088302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-935294165',id=16,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4PSWGM/1ftzwfDAUuYKxU/kl/E9ddsjcDHS5qvs1EZt9ShsPr19Pfa5LyW4urTLQ7G5FMF4MozVRL9Ox3bsqMTLxcdONv1cFJ8IQVNm7DDDavOofdZzJVSCkLE5kGTiQ==',key_name='tempest-keypair-1422090515',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-rfdcmkpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=e153ead2-1bf6-410b-9b0a-3c1bef1f8062,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "address": "fa:16:3e:cd:43:9e", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d85393-dc", "ovs_interfaceid": "c3d85393-dc7a-40ef-84a8-0e7b69e8aaae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG os_vif [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d85393-dc, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=227c7fe2-aa5c-4364-96e3-a92032e8002d) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:42:45 user nova-compute[75292]: INFO os_vif [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:43:9e,bridge_name='br-int',has_traffic_filtering=True,id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d85393-dc')
Nov 14 14:42:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Deleting instance files /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062_del
Nov 14 14:42:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Deletion of /opt/stack/data/nova/instances/e153ead2-1bf6-410b-9b0a-3c1bef1f8062_del complete
Nov 14 14:42:46 user nova-compute[75292]: INFO nova.compute.manager [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:42:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.policy [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d907961ca894eaeac999bab8224c2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ea0f958209e4f098f0636fc392ec717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:42:46 user nova-compute[75292]: INFO nova.virt.block_device [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Booting with volume c72be6cc-e787-4536-b933-b06a88489a94 at /dev/vda
Nov 14 14:42:46 user nova-compute[75292]: DEBUG os_brick.utils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1b1717-6b00-49b4-888c-5b538d40a29c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017160b-dace-4e36-9a7d-c95e3bcb5e68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54e010c-9e11-4c03-8788-5c78ba675a7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[556bfc39-ac82-48f8-8776-bba2204f0c17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:42:46 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:42:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[738e15c3-951b-4702-8740-45e96821cf66]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG os_brick.utils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:46 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating existing volume attachment record: 39d4154a-b514-46b0-8ec0-4cade225be8b {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:47 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Took 1.18 seconds to deallocate network for instance.
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-e5e55525-2e7a-40c2-a03d-a74faa216877 req-8b8afa8f-f029-4d8c-8c41-c807a1a49472 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-deleted-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:47 user nova-compute[75292]: INFO nova.compute.manager [req-e5e55525-2e7a-40c2-a03d-a74faa216877 req-8b8afa8f-f029-4d8c-8c41-c807a1a49472 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Neutron deleted interface c3d85393-dc7a-40ef-84a8-0e7b69e8aaae; detaching it from the instance and deleting it from the info cache
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.network.neutron [req-e5e55525-2e7a-40c2-a03d-a74faa216877 req-8b8afa8f-f029-4d8c-8c41-c807a1a49472 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Successfully created port: 4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-e5e55525-2e7a-40c2-a03d-a74faa216877 req-8b8afa8f-f029-4d8c-8c41-c807a1a49472 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Detach interface failed, port_id=c3d85393-dc7a-40ef-84a8-0e7b69e8aaae, reason: Instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a28464d-258f-4762-bafa-57d57fb98da7 req-a2711edc-4cd7-46b4-8533-51e23b8cd450 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a28464d-258f-4762-bafa-57d57fb98da7 req-a2711edc-4cd7-46b4-8533-51e23b8cd450 service nova] Acquiring lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a28464d-258f-4762-bafa-57d57fb98da7 req-a2711edc-4cd7-46b4-8533-51e23b8cd450 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a28464d-258f-4762-bafa-57d57fb98da7 req-a2711edc-4cd7-46b4-8533-51e23b8cd450 service nova] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a28464d-258f-4762-bafa-57d57fb98da7 req-a2711edc-4cd7-46b4-8533-51e23b8cd450 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] No waiting events found dispatching network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:47 user nova-compute[75292]: WARNING nova.compute.manager [req-4a28464d-258f-4762-bafa-57d57fb98da7 req-a2711edc-4cd7-46b4-8533-51e23b8cd450 service nova] [instance: e153ead2-1bf6-410b-9b0a-3c1bef1f8062] Received unexpected event network-vif-plugged-c3d85393-dc7a-40ef-84a8-0e7b69e8aaae for instance with vm_state deleted and task_state None.
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:47 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Deleted allocations for instance e153ead2-1bf6-410b-9b0a-3c1bef1f8062
Nov 14 14:42:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5767d376-8c37-460f-a9bf-2abebea271ec tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "e153ead2-1bf6-410b-9b0a-3c1bef1f8062" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.694s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Successfully updated port: 4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquired lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating instance_info_cache with network_info: [{"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Releasing lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance network_info: |[{"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-changed-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Refreshing instance network info cache due to event network-changed-4ac54b9d-8973-4c56-be66-971e26ac903d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] Acquiring lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] Acquired lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG nova.network.neutron [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Refreshing network info cache for port 4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG nova.network.neutron [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updated VIF entry in instance network info cache for port 4ac54b9d-8973-4c56-be66-971e26ac903d. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG nova.network.neutron [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating instance_info_cache with network_info: [{"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2eab95de-cdf9-4e95-8483-780d7a445abc req-7ad12515-1985-4fab-9012-bb8dd69cc756 service nova] Releasing lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:42:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Creating image(s)
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Ensure instance console log exists: /opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Start _get_guest_xml network_info=[{"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '39d4154a-b514-46b0-8ec0-4cade225be8b', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50b9cfcd-94d5-4efa-9fd5-8553ffb9a052', 'attached_at': '', 'detached_at': '', 'volume_id': 'c72be6cc-e787-4536-b933-b06a88489a94', 'serial': 'c72be6cc-e787-4536-b933-b06a88489a94'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:42:51 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:42:51 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:51 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:51 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:51 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb6e8c3-4b47-4d42-b07c-5b8bb4b0639e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:42:51 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e889bd6-fd5b-4f8e-b6a8-2ad4653f47fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94] added
Nov 14 14:42:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7732afaa-244a-4903-95d5-688ff82c2764]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035915d-f244-4cbf-a57a-cc8ceb0cb6e9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UonbBYgr {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UonbBYgr" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4180ff-a4e3-484e-a423-44ad73c68590]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UonbBYgr'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa10e9-7d55-42fc-a521-4308d519d64d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d573a1bb-0096-45fb-9f73-94ee0d26a71d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9831b5-a394-4114-ad3f-6cd478692163]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]
Nov 14 14:42:51 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.
Nov 14 14:42:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a55acc-1aa2-4817-9783-cdd1beb4ba94]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[163c5cc0-ce06-4bcb-a218-ef5be707c2a5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:42:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc7fb4a-5f32-474a-8888-3d81a9194f0e]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:42:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26639386234666635', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639386234666635', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1382089811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1382089811',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXL14FTdkQpYas1YFHEy8DREzMtyxGvJrMS8ayO8pWfev65QDIVokNGzPZgeo0WpVNlhsgFiICYn4UVmFa4qRhuK6ujEEjVfOgf6j7HcOUueH+Tk2hZKJIseF3p+94IJQ==',key_name='tempest-keypair-493871016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ea0f958209e4f098f0636fc392ec717',ramdisk_id='',reservation_id='r-ezdq4bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1287985576',owner_user_name='tempest-ServerActionsV293TestJSON-1287985576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d907961ca894eaeac999bab8224c2c8',uuid=50b9cfcd-94d5-4efa-9fd5-8553ffb9a052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converting VIF {"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lazy-loading 'pci_devices' on Instance uuid 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:42:52 user nova-compute[75292]:   <uuid>50b9cfcd-94d5-4efa-9fd5-8553ffb9a052</uuid>
Nov 14 14:42:52 user nova-compute[75292]:   <name>instance-0000001a</name>
Nov 14 14:42:52 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:42:52 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:42:52 user nova-compute[75292]:   <metadata>
Nov 14 14:42:52 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:42:52 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:42:52 user nova-compute[75292]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1382089811</nova:name>
Nov 14 14:42:52 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:42:51</nova:creationTime>
Nov 14 14:42:52 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:42:52 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:42:52 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:42:52 user nova-compute[75292]:       <nova:owner>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:user uuid="8d907961ca894eaeac999bab8224c2c8">tempest-ServerActionsV293TestJSON-1287985576-project-member</nova:user>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:project uuid="1ea0f958209e4f098f0636fc392ec717">tempest-ServerActionsV293TestJSON-1287985576</nova:project>
Nov 14 14:42:52 user nova-compute[75292]:       </nova:owner>
Nov 14 14:42:52 user nova-compute[75292]:       <nova:ports>
Nov 14 14:42:52 user nova-compute[75292]:         <nova:port uuid="4ac54b9d-8973-4c56-be66-971e26ac903d">
Nov 14 14:42:52 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:42:52 user nova-compute[75292]:         </nova:port>
Nov 14 14:42:52 user nova-compute[75292]:       </nova:ports>
Nov 14 14:42:52 user nova-compute[75292]:     </nova:instance>
Nov 14 14:42:52 user nova-compute[75292]:   </metadata>
Nov 14 14:42:52 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:42:52 user nova-compute[75292]:     <system>
Nov 14 14:42:52 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:42:52 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:42:52 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:42:52 user nova-compute[75292]:       <entry name="serial">50b9cfcd-94d5-4efa-9fd5-8553ffb9a052</entry>
Nov 14 14:42:52 user nova-compute[75292]:       <entry name="uuid">50b9cfcd-94d5-4efa-9fd5-8553ffb9a052</entry>
Nov 14 14:42:52 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:42:52 user nova-compute[75292]:     </system>
Nov 14 14:42:52 user nova-compute[75292]:   </sysinfo>
Nov 14 14:42:52 user nova-compute[75292]:   <os>
Nov 14 14:42:52 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:42:52 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:42:52 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:42:52 user nova-compute[75292]:   </os>
Nov 14 14:42:52 user nova-compute[75292]:   <features>
Nov 14 14:42:52 user nova-compute[75292]:     <acpi/>
Nov 14 14:42:52 user nova-compute[75292]:     <apic/>
Nov 14 14:42:52 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:42:52 user nova-compute[75292]:   </features>
Nov 14 14:42:52 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:42:52 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:42:52 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:42:52 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:42:52 user nova-compute[75292]:   </clock>
Nov 14 14:42:52 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:42:52 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:42:52 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:42:52 user nova-compute[75292]:   </cpu>
Nov 14 14:42:52 user nova-compute[75292]:   <devices>
Nov 14 14:42:52 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:42:52 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:42:52 user nova-compute[75292]:       <source dev="/dev/sde"/>
Nov 14 14:42:52 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:42:52 user nova-compute[75292]:       <serial>c72be6cc-e787-4536-b933-b06a88489a94</serial>
Nov 14 14:42:52 user nova-compute[75292]:     </disk>
Nov 14 14:42:52 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:42:52 user nova-compute[75292]:       <mac address="fa:16:3e:3b:ee:2f"/>
Nov 14 14:42:52 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:42:52 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:42:52 user nova-compute[75292]:       <target dev="tap4ac54b9d-89"/>
Nov 14 14:42:52 user nova-compute[75292]:     </interface>
Nov 14 14:42:52 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:42:52 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052/console.log" append="off"/>
Nov 14 14:42:52 user nova-compute[75292]:     </serial>
Nov 14 14:42:52 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:42:52 user nova-compute[75292]:     <video>
Nov 14 14:42:52 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:42:52 user nova-compute[75292]:     </video>
Nov 14 14:42:52 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:42:52 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:42:52 user nova-compute[75292]:     </rng>
Nov 14 14:42:52 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:42:52 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:42:52 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:42:52 user nova-compute[75292]:     </memballoon>
Nov 14 14:42:52 user nova-compute[75292]:   </devices>
Nov 14 14:42:52 user nova-compute[75292]: </domain>
Nov 14 14:42:52 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1382089811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1382089811',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXL14FTdkQpYas1YFHEy8DREzMtyxGvJrMS8ayO8pWfev65QDIVokNGzPZgeo0WpVNlhsgFiICYn4UVmFa4qRhuK6ujEEjVfOgf6j7HcOUueH+Tk2hZKJIseF3p+94IJQ==',key_name='tempest-keypair-493871016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ea0f958209e4f098f0636fc392ec717',ramdisk_id='',reservation_id='r-ezdq4bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1287985576',owner_user_name='tempest-ServerActionsV293TestJSON-1287985576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d907961ca894eaeac999bab8224c2c8',uuid=50b9cfcd-94d5-4efa-9fd5-8553ffb9a052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converting VIF {"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG os_vif [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29617855-b3ce-51ab-b0e0-b514880ae2f3', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ac54b9d-89, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ac54b9d-89, col_values=(('qos', UUID('b1e3d669-53c2-48a9-ab84-ab130318c146')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ac54b9d-89, col_values=(('external_ids', {'iface-id': '4ac54b9d-8973-4c56-be66-971e26ac903d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ee:2f', 'vm-uuid': '50b9cfcd-94d5-4efa-9fd5-8553ffb9a052'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:52 user nova-compute[75292]: INFO os_vif [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89')
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:42:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] No VIF found with MAC fa:16:3e:3b:ee:2f, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:42:53 user nova-compute[75292]: INFO nova.compute.manager [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Unrescuing
Nov 14 14:42:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:53 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:42:53 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:53 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'flavor' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-edb58829-5766-4f91-b1aa-bb8de6d2789f req-1c1e9247-046f-4630-83d8-9f64bbe6077c service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edb58829-5766-4f91-b1aa-bb8de6d2789f req-1c1e9247-046f-4630-83d8-9f64bbe6077c service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edb58829-5766-4f91-b1aa-bb8de6d2789f req-1c1e9247-046f-4630-83d8-9f64bbe6077c service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edb58829-5766-4f91-b1aa-bb8de6d2789f req-1c1e9247-046f-4630-83d8-9f64bbe6077c service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-edb58829-5766-4f91-b1aa-bb8de6d2789f req-1c1e9247-046f-4630-83d8-9f64bbe6077c service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:54 user nova-compute[75292]: WARNING nova.compute.manager [req-edb58829-5766-4f91-b1aa-bb8de6d2789f req-1c1e9247-046f-4630-83d8-9f64bbe6077c service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-d671304c-7a29-4c2e-9141-560b154b119b req-62e6de3e-0483-4dda-b270-6e91c0b9085f service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d671304c-7a29-4c2e-9141-560b154b119b req-62e6de3e-0483-4dda-b270-6e91c0b9085f service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d671304c-7a29-4c2e-9141-560b154b119b req-62e6de3e-0483-4dda-b270-6e91c0b9085f service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d671304c-7a29-4c2e-9141-560b154b119b req-62e6de3e-0483-4dda-b270-6e91c0b9085f service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-d671304c-7a29-4c2e-9141-560b154b119b req-62e6de3e-0483-4dda-b270-6e91c0b9085f service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:54 user nova-compute[75292]: WARNING nova.compute.manager [req-d671304c-7a29-4c2e-9141-560b154b119b req-62e6de3e-0483-4dda-b270-6e91c0b9085f service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state building and task_state spawning.
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:54 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance destroyed successfully.
Nov 14 14:42:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:56 user nova-compute[75292]: WARNING nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing instance network info cache due to event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.network.neutron [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:42:56 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance spawned successfully.
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-7fde2d9d-3366-404f-8e05-ac515c3926af req-c79923d9-9f42-4ce5-869f-83b2f9d1c040 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7fde2d9d-3366-404f-8e05-ac515c3926af req-c79923d9-9f42-4ce5-869f-83b2f9d1c040 service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7fde2d9d-3366-404f-8e05-ac515c3926af req-c79923d9-9f42-4ce5-869f-83b2f9d1c040 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7fde2d9d-3366-404f-8e05-ac515c3926af req-c79923d9-9f42-4ce5-869f-83b2f9d1c040 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-7fde2d9d-3366-404f-8e05-ac515c3926af req-c79923d9-9f42-4ce5-869f-83b2f9d1c040 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:56 user nova-compute[75292]: WARNING nova.compute.manager [req-7fde2d9d-3366-404f-8e05-ac515c3926af req-c79923d9-9f42-4ce5-869f-83b2f9d1c040 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state building and task_state spawning.
Nov 14 14:42:56 user nova-compute[75292]: INFO nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f97410b4-b961-4b67-be80-49404e1849b2 is timed out.
Nov 14 14:42:56 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Successfully detached device vdc from instance f97410b4-b961-4b67-be80-49404e1849b2 from the live domain config.
Nov 14 14:42:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXLIaumr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:42:56 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:42:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:56 user nova-compute[75292]: INFO nova.compute.manager [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Took 11.11 seconds to build instance.
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0118bd9-bf41-4465-8f2c-1f5cd125753a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:42:56 user nova-compute[75292]: No targets found.
Nov 14 14:42:56 user nova-compute[75292]: iSNS:
Nov 14 14:42:56 user nova-compute[75292]: No targets found.
Nov 14 14:42:56 user nova-compute[75292]: STATIC:
Nov 14 14:42:56 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0
Nov 14 14:42:56 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:56 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:56 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94
Nov 14 14:42:56 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:56 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:56 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:42:56 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:56 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:56 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093
Nov 14 14:42:56 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:42:56 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:42:56 user nova-compute[75292]: FIRMWARE:
Nov 14 14:42:56 user nova-compute[75292]: No targets found.
Nov 14 14:42:56 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:42:56 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:42:56 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d2eabd45-38e2-4500-81b3-944e8db35c21 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.214s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dc8c12-9e55-499e-8700-7f2abc25e0ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b21f7fa-4b6c-428c-b2d1-2e9f74379768]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:42:57 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5412e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updated VIF entry in instance network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a201500d-d5a3-4f43-8296-21c721849a12]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing instance network info cache due to event network-changed-c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Refreshing network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c3fe77-144c-4247-baab-a3a3bec24f1a]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e598b8-1cec-4844-a458-71b97e344bda]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e8698-f2fa-45be-9bd1-a5d32ad2cb23]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88c67c1-85fc-40ec-b4e4-18ac8b02bf5c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f3204-c535-4232-aeae-e1f24077e9ae]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260]
Nov 14 14:42:57 user nova-compute[75292]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0, portal: 172.16.0.220,3260] successful.
Nov 14 14:42:57 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:244f7874-f342-4afa-9dd4-368436a6fda0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5a3d64-fdcd-4e01-aa56-89c4304ce1f2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] <== disconnect_volume: return (347ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updated VIF entry in instance network info cache for port c1259aab-5d16-453a-9a2a-43fc1b982a07. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-20fddd42-dfb8-401f-936a-9085602eca8b req-484e6276-9dea-4297-b698-39bea6fb5a3e service nova] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:42:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG nova.objects.instance [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'flavor' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-be3323f7-0b8a-4fc9-8d62-29f2a0ed225b tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:58 user nova-compute[75292]: WARNING nova.compute.manager [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:42:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:42:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:42:58 user nova-compute[75292]: WARNING nova.compute.manager [req-b243a5f3-b752-44fc-9348-2d5772475d55 req-e3c9efb7-fee0-46c2-8cae-2784c72a3c13 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:42:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ac86f699-d2cd-4469-9496-9500f676cd11 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:42:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:43:04 user nova-compute[75292]: INFO nova.compute.manager [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] instance snapshotting
Nov 14 14:43:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Beginning live snapshot process
Nov 14 14:43:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp63hmviqu/9a3491efc52f43db8c981abfa04e025a.delta 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp63hmviqu/9a3491efc52f43db8c981abfa04e025a.delta 1073741824" returned: 0 in 0.057s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 14:43:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:43:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:43:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 14:43:06 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp63hmviqu/9a3491efc52f43db8c981abfa04e025a.delta /opt/stack/data/nova/instances/snapshots/tmp63hmviqu/9a3491efc52f43db8c981abfa04e025a {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:43:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:07 user nova-compute[75292]: INFO nova.compute.manager [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Terminating instance
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp63hmviqu/9a3491efc52f43db8c981abfa04e025a.delta /opt/stack/data/nova/instances/snapshots/tmp63hmviqu/9a3491efc52f43db8c981abfa04e025a" returned: 0 in 0.611s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Snapshot extracted, beginning image upload
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-b9d37c66-460b-40da-8954-1a35189a63b7 req-f479db50-2ae4-41a4-a2b9-aad4f817f514 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-unplugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b9d37c66-460b-40da-8954-1a35189a63b7 req-f479db50-2ae4-41a4-a2b9-aad4f817f514 service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b9d37c66-460b-40da-8954-1a35189a63b7 req-f479db50-2ae4-41a4-a2b9-aad4f817f514 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b9d37c66-460b-40da-8954-1a35189a63b7 req-f479db50-2ae4-41a4-a2b9-aad4f817f514 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-b9d37c66-460b-40da-8954-1a35189a63b7 req-f479db50-2ae4-41a4-a2b9-aad4f817f514 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-unplugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-b9d37c66-460b-40da-8954-1a35189a63b7 req-f479db50-2ae4-41a4-a2b9-aad4f817f514 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-unplugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:43:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Instance destroyed successfully.
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'resources' on Instance uuid 7397dbe8-471b-40b2-8dea-cc8078a92a77 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517126303',display_name='tempest-TestMinimumBasicScenario-server-1517126303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517126303',id=20,image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt2ywkWaNq23mGaooT+uHlWwwF9vKnixAx9vlSB9Q+NH/mta3IUdPVfprVjztpV2oEZGR1682f2+QsXbgBCUqyOv5ngZDC8JDUuZQKtpzMw3ekrQHi9AjN7o6iH3rdSsg==',key_name='tempest-TestMinimumBasicScenario-1832686439',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-qbxoq5lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30789dba-62a6-4cf2-a865-f871f696c6f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:40:30Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=7397dbe8-471b-40b2-8dea-cc8078a92a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "address": "fa:16:3e:fe:e0:43", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea62a5d-74", "ovs_interfaceid": "fea62a5d-74a2-4285-80fc-85b092e61f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG os_vif [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfea62a5d-74, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e59c102-60bf-4ecf-842f-57cfe0c8df8c) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:07 user nova-compute[75292]: INFO os_vif [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:e0:43,bridge_name='br-int',has_traffic_filtering=True,id=fea62a5d-74a2-4285-80fc-85b092e61f1a,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea62a5d-74')
Nov 14 14:43:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Deleting instance files /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77_del
Nov 14 14:43:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Deletion of /opt/stack/data/nova/instances/7397dbe8-471b-40b2-8dea-cc8078a92a77_del complete
Nov 14 14:43:07 user nova-compute[75292]: INFO nova.compute.manager [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 14:43:07 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:43:07 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:43:08 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Took 0.54 seconds to deallocate network for instance.
Nov 14 14:43:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-9c755c65-7bf4-4df5-b896-22624a5bde2f req-d5dfd56c-5246-4c17-845a-397e9cc232aa service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-deleted-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:08 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Deleted allocations for instance 7397dbe8-471b-40b2-8dea-cc8078a92a77
Nov 14 14:43:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95da2027-6144-457b-9f1e-89a96765c789 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.017s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-f6abe730-2bc9-4419-858d-2fe420859177 req-f08d8682-cc0a-4089-8046-fb71fb0fb588 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f6abe730-2bc9-4419-858d-2fe420859177 req-f08d8682-cc0a-4089-8046-fb71fb0fb588 service nova] Acquiring lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f6abe730-2bc9-4419-858d-2fe420859177 req-f08d8682-cc0a-4089-8046-fb71fb0fb588 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f6abe730-2bc9-4419-858d-2fe420859177 req-f08d8682-cc0a-4089-8046-fb71fb0fb588 service nova] Lock "7397dbe8-471b-40b2-8dea-cc8078a92a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-f6abe730-2bc9-4419-858d-2fe420859177 req-f08d8682-cc0a-4089-8046-fb71fb0fb588 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] No waiting events found dispatching network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:43:09 user nova-compute[75292]: WARNING nova.compute.manager [req-f6abe730-2bc9-4419-858d-2fe420859177 req-f08d8682-cc0a-4089-8046-fb71fb0fb588 service nova] [instance: 7397dbe8-471b-40b2-8dea-cc8078a92a77] Received unexpected event network-vif-plugged-fea62a5d-74a2-4285-80fc-85b092e61f1a for instance with vm_state deleted and task_state None.
Nov 14 14:43:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:09 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Snapshot image upload complete
Nov 14 14:43:10 user nova-compute[75292]: INFO nova.compute.manager [None req-de06f957-3cb9-48e1-a23a-d6c4b4fd13c6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Took 6.09 seconds to snapshot the instance on the hypervisor.
Nov 14 14:43:10 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:10 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:10 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:43:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:43:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:43:15 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7592MB free_disk=25.22976303100586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f97410b4-b961-4b67-be80-49404e1849b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a7678b53-9d02-4504-97a5-8a92be22318c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:43:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:43:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:43:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:26 user nova-compute[75292]: INFO nova.compute.manager [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Detaching volume ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:43:26 user nova-compute[75292]: INFO nova.virt.block_device [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Attempting to driver detach volume ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 from mountpoint /dev/vdb
Nov 14 14:43:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Attempting to detach device vdb from instance 48cc4550-2634-4291-a55b-e66338585160 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:43:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:43:26 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:43:26 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:43:26 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:43:26 user nova-compute[75292]:   <serial>ace0a3c1-37ad-4bfe-b1b3-cdba59134c85</serial>
Nov 14 14:43:26 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:43:26 user nova-compute[75292]: </disk>
Nov 14 14:43:26 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:43:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Successfully detached device vdb from instance 48cc4550-2634-4291-a55b-e66338585160 from the persistent domain config.
Nov 14 14:43:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 48cc4550-2634-4291-a55b-e66338585160 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:43:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:43:26 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:43:26 user nova-compute[75292]:   <source dev="/dev/sdd"/>
Nov 14 14:43:26 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:43:26 user nova-compute[75292]:   <serial>ace0a3c1-37ad-4bfe-b1b3-cdba59134c85</serial>
Nov 14 14:43:26 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:43:26 user nova-compute[75292]: </disk>
Nov 14 14:43:26 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:27 user nova-compute[75292]: INFO nova.compute.manager [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Detaching volume 81e4711a-491b-43ff-809b-f7a51dfcb093
Nov 14 14:43:27 user nova-compute[75292]: INFO nova.virt.block_device [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Attempting to driver detach volume 81e4711a-491b-43ff-809b-f7a51dfcb093 from mountpoint /dev/vdb
Nov 14 14:43:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Attempting to detach device vdb from instance f97410b4-b961-4b67-be80-49404e1849b2 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:43:27 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:43:27 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:43:27 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:43:27 user nova-compute[75292]:   <serial>81e4711a-491b-43ff-809b-f7a51dfcb093</serial>
Nov 14 14:43:27 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:43:27 user nova-compute[75292]: </disk>
Nov 14 14:43:27 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:43:27 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Successfully detached device vdb from instance f97410b4-b961-4b67-be80-49404e1849b2 from the persistent domain config.
Nov 14 14:43:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f97410b4-b961-4b67-be80-49404e1849b2 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:43:27 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:43:27 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:43:27 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:43:27 user nova-compute[75292]:   <serial>81e4711a-491b-43ff-809b-f7a51dfcb093</serial>
Nov 14 14:43:27 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:43:27 user nova-compute[75292]: </disk>
Nov 14 14:43:27 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:43:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing instance network info cache due to event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:43:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:43:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:43:30 user nova-compute[75292]: DEBUG nova.network.neutron [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG nova.objects.instance [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'flavor' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:31 user nova-compute[75292]: INFO nova.compute.manager [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Attaching volume 7e2780c1-307e-4ec8-bb59-29800c46daab to /dev/vdb
Nov 14 14:43:31 user nova-compute[75292]: DEBUG os_brick.utils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26ed268-7039-4bf3-a405-4671e5ba3c78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[84134768-1d83-4f48-9632-f977fda06959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff23094-e4df-4f17-99b7-4f49cff3a47e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3a3dd-6df4-4d3b-ab66-3432960f68ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:43:31 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5dfafe-ac6b-4403-94bf-4bb11b9f7d85]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG os_brick.utils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating existing volume attachment record: 80fb23fb-89d4-4600-9e9d-faa3e1e0e148 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG nova.network.neutron [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updated VIF entry in instance network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG nova.network.neutron [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:43:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a763dd6a-50b2-4aa8-b47b-ca29d27caec3 req-d01c05df-c1e0-4873-9873-961dc2e2622e service nova] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:43:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwYMrqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:43:35 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:43:35 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:43:35 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b15626-aa0e-4129-9ca9-33e3a88048be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:43:35 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbce11b8-caf2-4ad6-a89d-a2cee54c8a90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab] added
Nov 14 14:43:35 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d46dce8-2625-4778-aca7-f26c7e20db7d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08dd4e-c091-4ff2-a122-19e00c0b5d9e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmwYMrqP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmwYMrqP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1fe96-4675-4ebc-9456-cb5c5d780b17]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmwYMrqP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86ba69-2d59-4087-b7f1-892b5d600906]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce9d4a4-c504-4b69-bf8f-c3135338347e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[980cdb8f-3ce7-4248-8f07-f85749ebed18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260]
Nov 14 14:43:36 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260] successful.
Nov 14 14:43:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a23821-a286-495e-aba8-43abd8e6339e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c60151-2c32-4481-a67d-97990d0e6a71]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:43:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:36 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:43:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b75874-6f6d-40af-a723-8c745f6683ac]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:43:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwYMrqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23066616133386639', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066616133386639', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'flavor' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:43:37 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:43:37 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:43:37 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:43:37 user nova-compute[75292]:   <serial>7e2780c1-307e-4ec8-bb59-29800c46daab</serial>
Nov 14 14:43:37 user nova-compute[75292]: </disk>
Nov 14 14:43:37 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:ff:7b:57, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc858c5f-851c-4d58-be7c-a9d8493df1f6 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.502s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:39 user nova-compute[75292]: INFO nova.compute.manager [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Rescuing
Nov 14 14:43:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:43:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:43:39 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:43:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:39 user nova-compute[75292]: DEBUG nova.network.neutron [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:43:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f998e9e-4765-41e2-9857-b4a3ba14cf84 req-d8f11fb6-cb6e-485b-a761-31e573411ad3 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f998e9e-4765-41e2-9857-b4a3ba14cf84 req-d8f11fb6-cb6e-485b-a761-31e573411ad3 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f998e9e-4765-41e2-9857-b4a3ba14cf84 req-d8f11fb6-cb6e-485b-a761-31e573411ad3 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f998e9e-4765-41e2-9857-b4a3ba14cf84 req-d8f11fb6-cb6e-485b-a761-31e573411ad3 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f998e9e-4765-41e2-9857-b4a3ba14cf84 req-d8f11fb6-cb6e-485b-a761-31e573411ad3 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:43:40 user nova-compute[75292]: WARNING nova.compute.manager [req-1f998e9e-4765-41e2-9857-b4a3ba14cf84 req-d8f11fb6-cb6e-485b-a761-31e573411ad3 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state active and task_state rescuing.
Nov 14 14:43:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance destroyed successfully.
Nov 14 14:43:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Attempting rescue
Nov 14 14:43:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75292) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:43:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Creating image(s)
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'trusted_certs' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue" returned: 0 in 0.163s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'migration_context' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.base [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<a7678b53-9d02-4504-97a5-8a92be22318c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Start _get_guest_xml network_info=[{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:ff:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'resources' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.base [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<a7678b53-9d02-4504-97a5-8a92be22318c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'numa_topology' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.base [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<a7678b53-9d02-4504-97a5-8a92be22318c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:43:41 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:43:41 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.base [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<a7678b53-9d02-4504-97a5-8a92be22318c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-114219581',display_name='tempest-ServerRescueNegativeTestJSON-server-114219581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-114219581',id=25,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtjnRl1Ks4Lpj+FP0MXNTlSFtMOyGZjsfkyZzWmXWa4qP8BIQlnb97O1Nz2V70smYhF6KnmlAD+18T86hqfoM6IUejgcYHG0amcmcYJ2L9mekZvZGh25+reH/cSjEyXDQ==',key_name='tempest-keypair-1120055896',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:41:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-tmfjgu0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:41:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9970be0d6d0a4c7193237192da054e8c',uuid=a7678b53-9d02-4504-97a5-8a92be22318c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:ff:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "vif_mac": "fa:16:3e:ff:7b:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'pci_devices' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.objects.base [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Object Instance<a7678b53-9d02-4504-97a5-8a92be22318c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:43:41 user nova-compute[75292]:   <uuid>a7678b53-9d02-4504-97a5-8a92be22318c</uuid>
Nov 14 14:43:41 user nova-compute[75292]:   <name>instance-00000019</name>
Nov 14 14:43:41 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:43:41 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:43:41 user nova-compute[75292]:   <metadata>
Nov 14 14:43:41 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:43:41 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:43:41 user nova-compute[75292]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-114219581</nova:name>
Nov 14 14:43:41 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:43:41</nova:creationTime>
Nov 14 14:43:41 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:43:41 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:43:41 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:43:41 user nova-compute[75292]:       <nova:owner>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:user uuid="9970be0d6d0a4c7193237192da054e8c">tempest-ServerRescueNegativeTestJSON-1737174677-project-member</nova:user>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:project uuid="850c4eb7326f46c59998de50b99686c0">tempest-ServerRescueNegativeTestJSON-1737174677</nova:project>
Nov 14 14:43:41 user nova-compute[75292]:       </nova:owner>
Nov 14 14:43:41 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:43:41 user nova-compute[75292]:       <nova:ports>
Nov 14 14:43:41 user nova-compute[75292]:         <nova:port uuid="b5bee998-bef9-45ef-9249-7c33330c9960">
Nov 14 14:43:41 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 14:43:41 user nova-compute[75292]:         </nova:port>
Nov 14 14:43:41 user nova-compute[75292]:       </nova:ports>
Nov 14 14:43:41 user nova-compute[75292]:     </nova:instance>
Nov 14 14:43:41 user nova-compute[75292]:   </metadata>
Nov 14 14:43:41 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:43:41 user nova-compute[75292]:     <system>
Nov 14 14:43:41 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:43:41 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:43:41 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:43:41 user nova-compute[75292]:       <entry name="serial">a7678b53-9d02-4504-97a5-8a92be22318c</entry>
Nov 14 14:43:41 user nova-compute[75292]:       <entry name="uuid">a7678b53-9d02-4504-97a5-8a92be22318c</entry>
Nov 14 14:43:41 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:43:41 user nova-compute[75292]:     </system>
Nov 14 14:43:41 user nova-compute[75292]:   </sysinfo>
Nov 14 14:43:41 user nova-compute[75292]:   <os>
Nov 14 14:43:41 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:43:41 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:43:41 user nova-compute[75292]:   </os>
Nov 14 14:43:41 user nova-compute[75292]:   <features>
Nov 14 14:43:41 user nova-compute[75292]:     <acpi/>
Nov 14 14:43:41 user nova-compute[75292]:     <apic/>
Nov 14 14:43:41 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:43:41 user nova-compute[75292]:   </features>
Nov 14 14:43:41 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:43:41 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:43:41 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:43:41 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:43:41 user nova-compute[75292]:   </clock>
Nov 14 14:43:41 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:43:41 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:43:41 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:43:41 user nova-compute[75292]:   </cpu>
Nov 14 14:43:41 user nova-compute[75292]:   <devices>
Nov 14 14:43:41 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:43:41 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:43:41 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue"/>
Nov 14 14:43:41 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:43:41 user nova-compute[75292]:     </disk>
Nov 14 14:43:41 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:43:41 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:43:41 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk"/>
Nov 14 14:43:41 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:43:41 user nova-compute[75292]:     </disk>
Nov 14 14:43:41 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:43:41 user nova-compute[75292]:       <mac address="fa:16:3e:ff:7b:57"/>
Nov 14 14:43:41 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:43:41 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:43:41 user nova-compute[75292]:       <target dev="tapb5bee998-be"/>
Nov 14 14:43:41 user nova-compute[75292]:     </interface>
Nov 14 14:43:41 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:43:41 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/console.log" append="off"/>
Nov 14 14:43:41 user nova-compute[75292]:     </serial>
Nov 14 14:43:41 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:43:41 user nova-compute[75292]:     <video>
Nov 14 14:43:41 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:43:41 user nova-compute[75292]:     </video>
Nov 14 14:43:41 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:43:41 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:43:41 user nova-compute[75292]:     </rng>
Nov 14 14:43:41 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:43:41 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:43:41 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:43:41 user nova-compute[75292]:     </memballoon>
Nov 14 14:43:41 user nova-compute[75292]:   </devices>
Nov 14 14:43:41 user nova-compute[75292]: </domain>
Nov 14 14:43:41 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:43:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance destroyed successfully.
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:43:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] No VIF found with MAC fa:16:3e:ff:7b:57, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-bf8c8c59-7883-4c50-820a-6079e626edd5 req-873805a5-45ae-46a4-b3db-267ec67df197 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf8c8c59-7883-4c50-820a-6079e626edd5 req-873805a5-45ae-46a4-b3db-267ec67df197 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf8c8c59-7883-4c50-820a-6079e626edd5 req-873805a5-45ae-46a4-b3db-267ec67df197 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf8c8c59-7883-4c50-820a-6079e626edd5 req-873805a5-45ae-46a4-b3db-267ec67df197 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-bf8c8c59-7883-4c50-820a-6079e626edd5 req-873805a5-45ae-46a4-b3db-267ec67df197 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:43:42 user nova-compute[75292]: WARNING nova.compute.manager [req-bf8c8c59-7883-4c50-820a-6079e626edd5 req-873805a5-45ae-46a4-b3db-267ec67df197 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state active and task_state rescuing.
Nov 14 14:43:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:43:44 user nova-compute[75292]: WARNING nova.compute.manager [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state active and task_state rescuing.
Nov 14 14:43:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:43:44 user nova-compute[75292]: WARNING nova.compute.manager [req-915f6460-adcd-4d0b-afbe-52612d517795 req-49c4d38a-21fb-4954-99de-69b73dc79eeb service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state active and task_state rescuing.
Nov 14 14:43:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cd63422a-8509-4175-9e50-7751ff5a7863 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:43:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 48cc4550-2634-4291-a55b-e66338585160 is timed out.
Nov 14 14:43:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Successfully detached device vdb from instance 48cc4550-2634-4291-a55b-e66338585160 from the live domain config.
Nov 14 14:43:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nxQhMPJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:43:47 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4b9e1-7465-49fa-8192-f9cb9a24101e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:43:47 user nova-compute[75292]: No targets found.
Nov 14 14:43:47 user nova-compute[75292]: iSNS:
Nov 14 14:43:47 user nova-compute[75292]: No targets found.
Nov 14 14:43:47 user nova-compute[75292]: STATIC:
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: FIRMWARE:
Nov 14 14:43:47 user nova-compute[75292]: No targets found.
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:43:47 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:43:47 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8048e7be-f74b-44d0-b0f4-2da0acad6c50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4f4ed1-5f1e-4c4f-b7a2-dad7f64bbabb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c13ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85'): ({'sdd'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Removing single pathed devices sdd {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c519af1-3de9-40d2-9c8d-3f92cd91c0bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd80bba-2316-47e3-9d19-0221777b6e6e]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Flushing IO for device /dev/sdd {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ec449-d3c1-492a-958b-f1ffb0d2ce92]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a211cc9-bb09-4997-b130-c870ad02b2bc]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c24e90-dcdf-4899-abc7-3a4d8c41220e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dfbece-c2ab-4b01-a1af-fd597d094670]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260]
Nov 14 14:43:47 user nova-compute[75292]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85, portal: 172.16.0.220,3260] successful.
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace0a3c1-37ad-4bfe-b1b3-cdba59134c85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[102db01b-775c-4a41-8ea5-178ec581bc13]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] <== disconnect_volume: return (304ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:43:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f97410b4-b961-4b67-be80-49404e1849b2 is timed out.
Nov 14 14:43:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Successfully detached device vdb from instance f97410b4-b961-4b67-be80-49404e1849b2 from the live domain config.
Nov 14 14:43:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVaYAFML', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:43:47 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e41ae5c-8af2-4663-abb7-9e46fb01f6c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:43:47 user nova-compute[75292]: No targets found.
Nov 14 14:43:47 user nova-compute[75292]: iSNS:
Nov 14 14:43:47 user nova-compute[75292]: No targets found.
Nov 14 14:43:47 user nova-compute[75292]: STATIC:
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:43:47 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:43:47 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:43:47 user nova-compute[75292]: FIRMWARE:
Nov 14 14:43:47 user nova-compute[75292]: No targets found.
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:43:47 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:43:47 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5263f31a-0057-4e77-9b2b-d0665bcd72bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b96527-dcc9-4527-9368-2ad589763eac]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:43:47 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:43:47 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542b3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2325dc9-cc72-4ee7-bfff-bbbb8b71dc64]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[971bca2b-7b71-40b6-afc2-2de6be03188c]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[25211f42-94db-4ee8-b696-ed011497692b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef34ef5-e97d-47dc-8378-302453c39924]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4996407-d198-45b6-8f98-4fa4d69e48c7]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[01822499-b3ba-41b2-8067-9ddca8b039bf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260]
Nov 14 14:43:48 user nova-compute[75292]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093, portal: 172.16.0.220,3260] successful.
Nov 14 14:43:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e4711a-491b-43ff-809b-f7a51dfcb093 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db1445d-545a-4cfa-b36e-ba0e1e8d4ca7]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] <== disconnect_volume: return (316ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'flavor' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-17238c05-9e97-46d7-aef7-1ef2ed047e54 tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'flavor' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:43:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04f70eea-aeaf-4330-8ee4-f71be29fa287 tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:55 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:43:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:43:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:43:55 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:43:55 user nova-compute[75292]: INFO nova.compute.claims [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Claim successful on node user
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:43:56 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.policy [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f4a3c09bab1412dbb88bcbe9d90b120', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e4a841b86434196bfdab20c1d3d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:43:56 user nova-compute[75292]: INFO nova.virt.block_device [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Booting with volume 06d30c2d-a92f-44b6-ab5f-66d14fb9919d at /dev/vda
Nov 14 14:43:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d21ea35-b8e3-414a-886f-fe7a8b46e988]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41330e7a-6b80-4f97-bf56-589187e93222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7048d3-df32-4664-be2e-5688791995a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e694254-49c9-4799-9425-1d63e47b21ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:43:56 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:43:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ac984-a168-4b24-a083-84e82ab1cb29]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating existing volume attachment record: a363ec08-763b-44ce-b550-1b9cc6e15e73 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:43:56 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Successfully created port: 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Successfully updated port: 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing instance network info cache due to event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance network_info: |[{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:43:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:43:58 user nova-compute[75292]: DEBUG nova.network.neutron [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updated VIF entry in instance network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:43:58 user nova-compute[75292]: DEBUG nova.network.neutron [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:43:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4085a01e-3b86-46d3-b317-4f01ba7d6b0e req-28b52ed5-1752-4192-945a-897a0c997bee service nova] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:43:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:44:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Creating image(s)
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Start _get_guest_xml network_info=[{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a363ec08-763b-44ce-b550-1b9cc6e15e73', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c9e6047-c647-4120-b74a-f62925f5849b', 'attached_at': '', 'detached_at': '', 'volume_id': '06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'serial': '06d30c2d-a92f-44b6-ab5f-66d14fb9919d'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:44:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:01 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d8ebcc-9a3f-4d88-aff3-b07dd801e122]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:44:01 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbf599-a87b-42ff-bb62-2378d4eded3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d] added
Nov 14 14:44:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08dc5b-5e01-415d-8ba6-7e74c6dc9dbf]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd51f7a6-34f3-419b-9780-188604edc2bc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TArhLNRa {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TArhLNRa" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[76197222-dd0f-4383-9211-cb9a5344b8ad]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TArhLNRa'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1728e988-6147-48e7-b2d7-df681916e3db]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:44:01 user nova-compute[75292]: INFO nova.compute.claims [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Claim successful on node user
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9717c1-2a64-4995-9623-21a96c6b6d33]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:01 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:01 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e47a8-dca4-4890-9e11-ecccf8298626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]
Nov 14 14:44:01 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.
Nov 14 14:44:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7988781-ad79-4631-8c87-3da967a5745b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14577b6-ecfc-4dfd-a3cf-3bca2f406dfa]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:01 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:01 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:01 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:01 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[542b68e2-fdd4-4be8-ba37-4bf30d56c34a]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:44:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.policy [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f20ed29c2964cf5bc164dc614dcb97c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4452a2c5ea7451997f344226737bf38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:44:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Creating image(s)
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "/opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "/opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "/opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "81696bfe1328617d9b8aa173d5103a6219de5537" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "81696bfe1328617d9b8aa173d5103a6219de5537" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23135643361616566', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135643361616566', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-868401689',display_name='tempest-TestShelveInstance-server-868401689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-868401689',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqjTyffMIw4MlE/BwkaOu7XIGIxkb5xs4EfszFIY6DNyGFuKvjQd6pdmU4qfiIAciBA9FVqY7s+vUx2ut01uwn4K4iy3jTixAifs6BEuGHCmcoaAYINj00+tjDpox9+/A==',key_name='tempest-TestShelveInstance-528629411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e25e4a841b86434196bfdab20c1d3d98',ramdisk_id='',reservation_id='r-59hu8x2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-395501576',owner_user_name='tempest-TestShelveInstance-395501576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:43:56Z,user_data=None,user_id='2f4a3c09bab1412dbb88bcbe9d90b120',uuid=7c9e6047-c647-4120-b74a-f62925f5849b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converting VIF {"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.objects.instance [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:44:02 user nova-compute[75292]:   <uuid>7c9e6047-c647-4120-b74a-f62925f5849b</uuid>
Nov 14 14:44:02 user nova-compute[75292]:   <name>instance-0000001b</name>
Nov 14 14:44:02 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:44:02 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:44:02 user nova-compute[75292]:   <metadata>
Nov 14 14:44:02 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:44:02 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:44:02 user nova-compute[75292]:       <nova:name>tempest-TestShelveInstance-server-868401689</nova:name>
Nov 14 14:44:02 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:44:01</nova:creationTime>
Nov 14 14:44:02 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:44:02 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:44:02 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:44:02 user nova-compute[75292]:       <nova:owner>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:user uuid="2f4a3c09bab1412dbb88bcbe9d90b120">tempest-TestShelveInstance-395501576-project-member</nova:user>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:project uuid="e25e4a841b86434196bfdab20c1d3d98">tempest-TestShelveInstance-395501576</nova:project>
Nov 14 14:44:02 user nova-compute[75292]:       </nova:owner>
Nov 14 14:44:02 user nova-compute[75292]:       <nova:ports>
Nov 14 14:44:02 user nova-compute[75292]:         <nova:port uuid="2d2bb8e3-d3c7-4b48-81a8-471d7c811276">
Nov 14 14:44:02 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 14:44:02 user nova-compute[75292]:         </nova:port>
Nov 14 14:44:02 user nova-compute[75292]:       </nova:ports>
Nov 14 14:44:02 user nova-compute[75292]:     </nova:instance>
Nov 14 14:44:02 user nova-compute[75292]:   </metadata>
Nov 14 14:44:02 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:44:02 user nova-compute[75292]:     <system>
Nov 14 14:44:02 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:44:02 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:44:02 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:44:02 user nova-compute[75292]:       <entry name="serial">7c9e6047-c647-4120-b74a-f62925f5849b</entry>
Nov 14 14:44:02 user nova-compute[75292]:       <entry name="uuid">7c9e6047-c647-4120-b74a-f62925f5849b</entry>
Nov 14 14:44:02 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:44:02 user nova-compute[75292]:     </system>
Nov 14 14:44:02 user nova-compute[75292]:   </sysinfo>
Nov 14 14:44:02 user nova-compute[75292]:   <os>
Nov 14 14:44:02 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:44:02 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:44:02 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:44:02 user nova-compute[75292]:   </os>
Nov 14 14:44:02 user nova-compute[75292]:   <features>
Nov 14 14:44:02 user nova-compute[75292]:     <acpi/>
Nov 14 14:44:02 user nova-compute[75292]:     <apic/>
Nov 14 14:44:02 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:44:02 user nova-compute[75292]:   </features>
Nov 14 14:44:02 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:44:02 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:44:02 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:44:02 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:44:02 user nova-compute[75292]:   </clock>
Nov 14 14:44:02 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:44:02 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:44:02 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:44:02 user nova-compute[75292]:   </cpu>
Nov 14 14:44:02 user nova-compute[75292]:   <devices>
Nov 14 14:44:02 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:44:02 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:44:02 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:44:02 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:44:02 user nova-compute[75292]:       <serial>06d30c2d-a92f-44b6-ab5f-66d14fb9919d</serial>
Nov 14 14:44:02 user nova-compute[75292]:     </disk>
Nov 14 14:44:02 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:44:02 user nova-compute[75292]:       <mac address="fa:16:3e:e6:71:94"/>
Nov 14 14:44:02 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:02 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:44:02 user nova-compute[75292]:       <target dev="tap2d2bb8e3-d3"/>
Nov 14 14:44:02 user nova-compute[75292]:     </interface>
Nov 14 14:44:02 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:44:02 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b/console.log" append="off"/>
Nov 14 14:44:02 user nova-compute[75292]:     </serial>
Nov 14 14:44:02 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:44:02 user nova-compute[75292]:     <video>
Nov 14 14:44:02 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:02 user nova-compute[75292]:     </video>
Nov 14 14:44:02 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:44:02 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:44:02 user nova-compute[75292]:     </rng>
Nov 14 14:44:02 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:44:02 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:44:02 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:44:02 user nova-compute[75292]:     </memballoon>
Nov 14 14:44:02 user nova-compute[75292]:   </devices>
Nov 14 14:44:02 user nova-compute[75292]: </domain>
Nov 14 14:44:02 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-868401689',display_name='tempest-TestShelveInstance-server-868401689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-868401689',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqjTyffMIw4MlE/BwkaOu7XIGIxkb5xs4EfszFIY6DNyGFuKvjQd6pdmU4qfiIAciBA9FVqY7s+vUx2ut01uwn4K4iy3jTixAifs6BEuGHCmcoaAYINj00+tjDpox9+/A==',key_name='tempest-TestShelveInstance-528629411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e25e4a841b86434196bfdab20c1d3d98',ramdisk_id='',reservation_id='r-59hu8x2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-395501576',owner_user_name='tempest-TestShelveInstance-395501576-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:43:56Z,user_data=None,user_id='2f4a3c09bab1412dbb88bcbe9d90b120',uuid=7c9e6047-c647-4120-b74a-f62925f5849b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converting VIF {"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG os_vif [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd963cfe-7ce3-526a-8f79-da016626114d', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2bb8e3-d3, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d2bb8e3-d3, col_values=(('qos', UUID('89e46409-15ca-4849-8b01-4c1e7b58d24f')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d2bb8e3-d3, col_values=(('external_ids', {'iface-id': '2d2bb8e3-d3c7-4b48-81a8-471d7c811276', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:71:94', 'vm-uuid': '7c9e6047-c647-4120-b74a-f62925f5849b'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.images [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] 5284ed19-d530-44f8-a89d-9cd3f0f47cd0 was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.part /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Successfully created port: ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:44:02 user nova-compute[75292]: INFO os_vif [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3')
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:44:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] No VIF found with MAC fa:16:3e:e6:71:94, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.part /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.converted" returned: 0 in 0.667s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "81696bfe1328617d9b8aa173d5103a6219de5537" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.477s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Successfully updated port: ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing instance network info cache due to event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG nova.network.neutron [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537 --force-share --output=json" returned: 0 in 0.388s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "81696bfe1328617d9b8aa173d5103a6219de5537" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "81696bfe1328617d9b8aa173d5103a6219de5537" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:03 user nova-compute[75292]: DEBUG nova.network.neutron [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537 --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537,backing_fmt=raw /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537,backing_fmt=raw /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk 1073741824" returned: 0 in 0.051s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "81696bfe1328617d9b8aa173d5103a6219de5537" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-41b61ff1-08fe-4711-b65b-cfc2172b7705 req-61aac9a1-854c-41cd-933d-3efaaa074448 service nova] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537 --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-a9ea8ad2-5dff-4fe7-bb39-c96cad20593d req-f56657d9-888c-4eb7-9d36-86975d63fb72 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a9ea8ad2-5dff-4fe7-bb39-c96cad20593d req-f56657d9-888c-4eb7-9d36-86975d63fb72 service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a9ea8ad2-5dff-4fe7-bb39-c96cad20593d req-f56657d9-888c-4eb7-9d36-86975d63fb72 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a9ea8ad2-5dff-4fe7-bb39-c96cad20593d req-f56657d9-888c-4eb7-9d36-86975d63fb72 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-a9ea8ad2-5dff-4fe7-bb39-c96cad20593d req-f56657d9-888c-4eb7-9d36-86975d63fb72 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:04 user nova-compute[75292]: WARNING nova.compute.manager [req-a9ea8ad2-5dff-4fe7-bb39-c96cad20593d req-f56657d9-888c-4eb7-9d36-86975d63fb72 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state building and task_state spawning.
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Cannot resize image /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Ensure instance console log exists: /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance network_info: |[{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Start _get_guest_xml network_info=[{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:43:58Z,direct_url=<?>,disk_format='qcow2',id=5284ed19-d530-44f8-a89d-9cd3f0f47cd0,min_disk=0,min_ram=0,name='tempest-scenario-img--1367690668',owner='d4452a2c5ea7451997f344226737bf38',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:44:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '5284ed19-d530-44f8-a89d-9cd3f0f47cd0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:44:04 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:04 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:43:58Z,direct_url=<?>,disk_format='qcow2',id=5284ed19-d530-44f8-a89d-9cd3f0f47cd0,min_disk=0,min_ram=0,name='tempest-scenario-img--1367690668',owner='d4452a2c5ea7451997f344226737bf38',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:44:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-499020818',display_name='tempest-TestMinimumBasicScenario-server-499020818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-499020818',id=28,image_ref='5284ed19-d530-44f8-a89d-9cd3f0f47cd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5IakQQHCYVIXrTZ6TitU85XYIXoxLT4mJm3JWUiK5f82G/0dug+BNO4GeT2Sy2HkQxzswwR4DvDZoiUcRwLz3y2u9DZ/gMujvfxybXrcJ9NODErn0jtilyVDeGEaAzdA==',key_name='tempest-TestMinimumBasicScenario-62354778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-1udj01sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5284ed19-d530-44f8-a89d-9cd3f0f47cd0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:02Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=807597ab-5dd2-4c69-b47d-5b958cc9b0f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'pci_devices' on Instance uuid 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:44:04 user nova-compute[75292]:   <uuid>807597ab-5dd2-4c69-b47d-5b958cc9b0f3</uuid>
Nov 14 14:44:04 user nova-compute[75292]:   <name>instance-0000001c</name>
Nov 14 14:44:04 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:44:04 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:44:04 user nova-compute[75292]:   <metadata>
Nov 14 14:44:04 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:44:04 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:44:04 user nova-compute[75292]:       <nova:name>tempest-TestMinimumBasicScenario-server-499020818</nova:name>
Nov 14 14:44:04 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:44:04</nova:creationTime>
Nov 14 14:44:04 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:44:04 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:44:04 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:44:04 user nova-compute[75292]:       <nova:owner>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:user uuid="8f20ed29c2964cf5bc164dc614dcb97c">tempest-TestMinimumBasicScenario-364849145-project-member</nova:user>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:project uuid="d4452a2c5ea7451997f344226737bf38">tempest-TestMinimumBasicScenario-364849145</nova:project>
Nov 14 14:44:04 user nova-compute[75292]:       </nova:owner>
Nov 14 14:44:04 user nova-compute[75292]:       <nova:root type="image" uuid="5284ed19-d530-44f8-a89d-9cd3f0f47cd0"/>
Nov 14 14:44:04 user nova-compute[75292]:       <nova:ports>
Nov 14 14:44:04 user nova-compute[75292]:         <nova:port uuid="ed98695a-a37b-4505-a91b-b531ea582d51">
Nov 14 14:44:04 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 14:44:04 user nova-compute[75292]:         </nova:port>
Nov 14 14:44:04 user nova-compute[75292]:       </nova:ports>
Nov 14 14:44:04 user nova-compute[75292]:     </nova:instance>
Nov 14 14:44:04 user nova-compute[75292]:   </metadata>
Nov 14 14:44:04 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:44:04 user nova-compute[75292]:     <system>
Nov 14 14:44:04 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:44:04 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:44:04 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:44:04 user nova-compute[75292]:       <entry name="serial">807597ab-5dd2-4c69-b47d-5b958cc9b0f3</entry>
Nov 14 14:44:04 user nova-compute[75292]:       <entry name="uuid">807597ab-5dd2-4c69-b47d-5b958cc9b0f3</entry>
Nov 14 14:44:04 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:44:04 user nova-compute[75292]:     </system>
Nov 14 14:44:04 user nova-compute[75292]:   </sysinfo>
Nov 14 14:44:04 user nova-compute[75292]:   <os>
Nov 14 14:44:04 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:44:04 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:44:04 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:44:04 user nova-compute[75292]:   </os>
Nov 14 14:44:04 user nova-compute[75292]:   <features>
Nov 14 14:44:04 user nova-compute[75292]:     <acpi/>
Nov 14 14:44:04 user nova-compute[75292]:     <apic/>
Nov 14 14:44:04 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:44:04 user nova-compute[75292]:   </features>
Nov 14 14:44:04 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:44:04 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:44:04 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:44:04 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:44:04 user nova-compute[75292]:   </clock>
Nov 14 14:44:04 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:44:04 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:44:04 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:44:04 user nova-compute[75292]:   </cpu>
Nov 14 14:44:04 user nova-compute[75292]:   <devices>
Nov 14 14:44:04 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:44:04 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:44:04 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk"/>
Nov 14 14:44:04 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:44:04 user nova-compute[75292]:     </disk>
Nov 14 14:44:04 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:44:04 user nova-compute[75292]:       <mac address="fa:16:3e:92:18:94"/>
Nov 14 14:44:04 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:04 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:44:04 user nova-compute[75292]:       <target dev="taped98695a-a3"/>
Nov 14 14:44:04 user nova-compute[75292]:     </interface>
Nov 14 14:44:04 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:44:04 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/console.log" append="off"/>
Nov 14 14:44:04 user nova-compute[75292]:     </serial>
Nov 14 14:44:04 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:44:04 user nova-compute[75292]:     <video>
Nov 14 14:44:04 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:04 user nova-compute[75292]:     </video>
Nov 14 14:44:04 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:44:04 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:44:04 user nova-compute[75292]:     </rng>
Nov 14 14:44:04 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:44:04 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:44:04 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:44:04 user nova-compute[75292]:     </memballoon>
Nov 14 14:44:04 user nova-compute[75292]:   </devices>
Nov 14 14:44:04 user nova-compute[75292]: </domain>
Nov 14 14:44:04 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-499020818',display_name='tempest-TestMinimumBasicScenario-server-499020818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-499020818',id=28,image_ref='5284ed19-d530-44f8-a89d-9cd3f0f47cd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5IakQQHCYVIXrTZ6TitU85XYIXoxLT4mJm3JWUiK5f82G/0dug+BNO4GeT2Sy2HkQxzswwR4DvDZoiUcRwLz3y2u9DZ/gMujvfxybXrcJ9NODErn0jtilyVDeGEaAzdA==',key_name='tempest-TestMinimumBasicScenario-62354778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-1udj01sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5284ed19-d530-44f8-a89d-9cd3f0f47cd0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:02Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=807597ab-5dd2-4c69-b47d-5b958cc9b0f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG os_vif [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a24efd0b-ac25-5f7b-a34c-ef7bd958724f', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped98695a-a3, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped98695a-a3, col_values=(('qos', UUID('f986e31d-c20d-4ad5-b42c-ed070ef8542b')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped98695a-a3, col_values=(('external_ids', {'iface-id': 'ed98695a-a37b-4505-a91b-b531ea582d51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:18:94', 'vm-uuid': '807597ab-5dd2-4c69-b47d-5b958cc9b0f3'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:04 user nova-compute[75292]: INFO os_vif [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3')
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:44:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No VIF found with MAC fa:16:3e:92:18:94, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:44:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:44:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 48cc4550-2634-4291-a55b-e66338585160] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:44:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance spawned successfully.
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:06 user nova-compute[75292]: INFO nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:06 user nova-compute[75292]: WARNING nova.compute.manager [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state building and task_state spawning.
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:06 user nova-compute[75292]: WARNING nova.compute.manager [req-04f13c4f-3e63-4857-984e-2312b1b78896 req-f253f5e5-2a6d-469e-8c25-ec0d1ab17b4d service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state building and task_state spawning.
Nov 14 14:44:06 user nova-compute[75292]: INFO nova.compute.manager [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Took 10.98 seconds to build instance.
Nov 14 14:44:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9e6d4af8-c345-46ee-8fec-0bbda0f9534d tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.079s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [{"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-48cc4550-2634-4291-a55b-e66338585160" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:44:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance spawned successfully.
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:08 user nova-compute[75292]: INFO nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:44:08 user nova-compute[75292]: INFO nova.compute.manager [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Took 7.34 seconds to build instance.
Nov 14 14:44:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0cd2fd03-1762-43b3-8fcf-1fede3aab2b9 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.462s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-236e5716-8a7a-414b-9da1-54452b2e3480 req-37ed05b6-8d24-42a4-8b2a-256910927eb2 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-236e5716-8a7a-414b-9da1-54452b2e3480 req-37ed05b6-8d24-42a4-8b2a-256910927eb2 service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-236e5716-8a7a-414b-9da1-54452b2e3480 req-37ed05b6-8d24-42a4-8b2a-256910927eb2 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-236e5716-8a7a-414b-9da1-54452b2e3480 req-37ed05b6-8d24-42a4-8b2a-256910927eb2 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-236e5716-8a7a-414b-9da1-54452b2e3480 req-37ed05b6-8d24-42a4-8b2a-256910927eb2 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:08 user nova-compute[75292]: WARNING nova.compute.manager [req-236e5716-8a7a-414b-9da1-54452b2e3480 req-37ed05b6-8d24-42a4-8b2a-256910927eb2 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state active and task_state None.
Nov 14 14:44:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:10 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:10 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:11 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:44:12 user nova-compute[75292]: INFO nova.compute.claims [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Claim successful on node user
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:12 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.784s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:44:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.policy [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38a8da6883ae40c4b12c8c483d598a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ef654d69c34328893549c7a124aebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:44:13 user nova-compute[75292]: INFO nova.virt.block_device [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Booting with blank volume at /dev/vda
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Successfully created port: 4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Successfully updated port: 4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-changed-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Refreshing instance network info cache due to event network-changed-4adea91d-1181-4be9-8723-50283103689f. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] Acquiring lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance network_info: |[{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] Acquired lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Refreshing network info cache for port 4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updated VIF entry in instance network info cache for port 4adea91d-1181-4be9-8723-50283103689f. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG nova.network.neutron [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dee02b5b-959c-483d-8803-471511603a5d req-681870d7-337c-4219-aa91-49316644b32a service nova] Releasing lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7550MB free_disk=25.201866149902344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 48cc4550-2634-4291-a55b-e66338585160 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f97410b4-b961-4b67-be80-49404e1849b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a7678b53-9d02-4504-97a5-8a92be22318c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7c9e6047-c647-4120-b74a-f62925f5849b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:44:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:17 user nova-compute[75292]: INFO nova.compute.manager [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Terminating instance
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:17 user nova-compute[75292]: INFO nova.compute.manager [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Terminating instance
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-ace40d63-c5b8-4e4b-b75c-dad6542a02d6 req-5a825f03-acba-4362-a848-e03fe71b1c3f service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ace40d63-c5b8-4e4b-b75c-dad6542a02d6 req-5a825f03-acba-4362-a848-e03fe71b1c3f service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ace40d63-c5b8-4e4b-b75c-dad6542a02d6 req-5a825f03-acba-4362-a848-e03fe71b1c3f service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ace40d63-c5b8-4e4b-b75c-dad6542a02d6 req-5a825f03-acba-4362-a848-e03fe71b1c3f service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-ace40d63-c5b8-4e4b-b75c-dad6542a02d6 req-5a825f03-acba-4362-a848-e03fe71b1c3f service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-ace40d63-c5b8-4e4b-b75c-dad6542a02d6 req-5a825f03-acba-4362-a848-e03fe71b1c3f service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-unplugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-a0ce448b-4035-4911-8bc9-6dddbc2e7d44 req-1d064cf5-56de-43e7-9bec-c5c9b39c7409 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-unplugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a0ce448b-4035-4911-8bc9-6dddbc2e7d44 req-1d064cf5-56de-43e7-9bec-c5c9b39c7409 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a0ce448b-4035-4911-8bc9-6dddbc2e7d44 req-1d064cf5-56de-43e7-9bec-c5c9b39c7409 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a0ce448b-4035-4911-8bc9-6dddbc2e7d44 req-1d064cf5-56de-43e7-9bec-c5c9b39c7409 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-a0ce448b-4035-4911-8bc9-6dddbc2e7d44 req-1d064cf5-56de-43e7-9bec-c5c9b39c7409 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-unplugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-a0ce448b-4035-4911-8bc9-6dddbc2e7d44 req-1d064cf5-56de-43e7-9bec-c5c9b39c7409 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-unplugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Instance destroyed successfully.
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lazy-loading 'resources' on Instance uuid 48cc4550-2634-4291-a55b-e66338585160 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1101039281',display_name='tempest-ServerStableDeviceRescueTest-server-1101039281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1101039281',id=17,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHebnVQS6FKvNF+wx3CgvjfoGurhBvBEYNi0m1NZpNycK+s9g88yhFnWyRIXs30QEGidB46jkt5hBj7CYDe5yZT8G0ZxFj/sDeK6FJM8iYWgXhKaUnWIJTU1oqWUd2vq5A==',key_name='tempest-keypair-899067751',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:41:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd4ea2ebbfce4ad3b2f94d34a0ecd9c9',ramdisk_id='',reservation_id='r-dzy4ans0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1897188969',owner_user_name='tempest-ServerStableDeviceRescueTest-1897188969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb1e97d9f26d4b6581e3c8461b9b5590',uuid=48cc4550-2634-4291-a55b-e66338585160,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converting VIF {"id": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "address": "fa:16:3e:8e:61:19", "network": {"id": "e05052db-0187-492b-893f-ec0e08186d98", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1962771291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd4ea2ebbfce4ad3b2f94d34a0ecd9c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1259aab-5d", "ovs_interfaceid": "c1259aab-5d16-453a-9a2a-43fc1b982a07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG os_vif [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1259aab-5d, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Instance destroyed successfully.
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lazy-loading 'resources' on Instance uuid f97410b4-b961-4b67-be80-49404e1849b2 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=686177a3-b4c3-44ac-9cd4-aecb5c8988e7) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2003982180',display_name='tempest-TestServerVolumeAttachmentScenario-server-2003982180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2003982180',id=23,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKalpf3WM5zDicVRpbCzJjv6ZyP/RIRfraAclF0Tch53sySwDZMUZhYZyYjKmwoiU9ksMTjjGLdol7AA0spSh9oqTi4eccj2sW2MHQShm4bvwNVEg8HlOGpKgXOgE4iV8g==',key_name='tempest-keypair-1153133975',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:40:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99d41ce185fa4a338faf970a4fe98a79',ramdisk_id='',reservation_id='r-eomgww6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1845144713',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1845144713-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:40:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8511393be8fa40cd97118906de2d83e0',uuid=f97410b4-b961-4b67-be80-49404e1849b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Converting VIF {"id": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "address": "fa:16:3e:71:d2:d1", "network": {"id": "98c1f2af-bc7e-416a-b0ad-373729716ea4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-182514170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99d41ce185fa4a338faf970a4fe98a79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53a879f8-37", "ovs_interfaceid": "53a879f8-37fd-432d-900f-44d9ab80fcf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG os_vif [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53a879f8-37, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: INFO os_vif [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:61:19,bridge_name='br-int',has_traffic_filtering=True,id=c1259aab-5d16-453a-9a2a-43fc1b982a07,network=Network(e05052db-0187-492b-893f-ec0e08186d98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1259aab-5d')
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Deleting instance files /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160_del
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Deletion of /opt/stack/data/nova/instances/48cc4550-2634-4291-a55b-e66338585160_del complete
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afef252d-9691-49b9-bb0f-91a36fa6f438) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: INFO os_vif [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:d2:d1,bridge_name='br-int',has_traffic_filtering=True,id=53a879f8-37fd-432d-900f-44d9ab80fcf8,network=Network(98c1f2af-bc7e-416a-b0ad-373729716ea4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53a879f8-37')
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Deleting instance files /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2_del
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Deletion of /opt/stack/data/nova/instances/f97410b4-b961-4b67-be80-49404e1849b2_del complete
Nov 14 14:44:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.compute.manager [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] [instance: 48cc4550-2634-4291-a55b-e66338585160] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:44:18 user nova-compute[75292]: INFO nova.compute.manager [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 14:44:18 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:44:18 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f97410b4-b961-4b67-be80-49404e1849b2] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG os_brick.utils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b8170-93f6-43ae-aa3e-33640bb5873f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53890260-afee-4b4c-b28f-a380f31da973]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27e9edc-a401-480c-87fe-16b1b6dd54d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3b536-0884-42ad-9aaf-86f53a86a303]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:44:19 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[910712ee-b063-4dd0-b24a-8b357ac039fa]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG os_brick.utils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating existing volume attachment record: 2c1a6579-e464-4d05-a66f-9c3db5a8af77 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:19 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Took 1.10 seconds to deallocate network for instance.
Nov 14 14:44:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-63352ef6-197c-4560-9c18-303578dacdd1 req-557c0d5d-8264-4bc7-acc3-eb47b1542cf1 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-deleted-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-e955efcf-6723-42ea-86d5-a2f8b44cac8f req-96f11212-0240-46c0-ae81-0bd7889498bb service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e955efcf-6723-42ea-86d5-a2f8b44cac8f req-96f11212-0240-46c0-ae81-0bd7889498bb service nova] Acquiring lock "48cc4550-2634-4291-a55b-e66338585160-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e955efcf-6723-42ea-86d5-a2f8b44cac8f req-96f11212-0240-46c0-ae81-0bd7889498bb service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e955efcf-6723-42ea-86d5-a2f8b44cac8f req-96f11212-0240-46c0-ae81-0bd7889498bb service nova] Lock "48cc4550-2634-4291-a55b-e66338585160-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-e955efcf-6723-42ea-86d5-a2f8b44cac8f req-96f11212-0240-46c0-ae81-0bd7889498bb service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] No waiting events found dispatching network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:19 user nova-compute[75292]: WARNING nova.compute.manager [req-e955efcf-6723-42ea-86d5-a2f8b44cac8f req-96f11212-0240-46c0-ae81-0bd7889498bb service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received unexpected event network-vif-plugged-c1259aab-5d16-453a-9a2a-43fc1b982a07 for instance with vm_state active and task_state deleting.
Nov 14 14:44:19 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:19 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 48cc4550-2634-4291-a55b-e66338585160] Took 1.18 seconds to deallocate network for instance.
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:44:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:20 user nova-compute[75292]: WARNING nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state deleted and task_state None.
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:20 user nova-compute[75292]: WARNING nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state deleted and task_state None.
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:20 user nova-compute[75292]: WARNING nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state deleted and task_state None.
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-unplugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-unplugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:20 user nova-compute[75292]: WARNING nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-unplugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state deleted and task_state None.
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Acquiring lock "f97410b4-b961-4b67-be80-49404e1849b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] Lock "f97410b4-b961-4b67-be80-49404e1849b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] No waiting events found dispatching network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:20 user nova-compute[75292]: WARNING nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: f97410b4-b961-4b67-be80-49404e1849b2] Received unexpected event network-vif-plugged-53a879f8-37fd-432d-900f-44d9ab80fcf8 for instance with vm_state deleted and task_state None.
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-456d73b6-e8f4-4392-bec8-3d9449c784ee req-ee50fee6-b5da-4b4b-af05-07eeaf4a9c55 service nova] [instance: 48cc4550-2634-4291-a55b-e66338585160] Received event network-vif-deleted-c1259aab-5d16-453a-9a2a-43fc1b982a07 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.406s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:20 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Deleted allocations for instance f97410b4-b961-4b67-be80-49404e1849b2
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e952aaa9-5030-427f-a8f5-f958ecfa792f tempest-TestServerVolumeAttachmentScenario-1845144713 tempest-TestServerVolumeAttachmentScenario-1845144713-project-member] Lock "f97410b4-b961-4b67-be80-49404e1849b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.827s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:20 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Deleted allocations for instance 48cc4550-2634-4291-a55b-e66338585160
Nov 14 14:44:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f24dc34e-eb73-4f0a-86d2-5e1a89f0228c tempest-ServerStableDeviceRescueTest-1897188969 tempest-ServerStableDeviceRescueTest-1897188969-project-member] Lock "48cc4550-2634-4291-a55b-e66338585160" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.528s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:44:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Creating image(s)
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Ensure instance console log exists: /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Start _get_guest_xml network_info=[{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c1a6579-e464-4d05-a66f-9c3db5a8af77', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5399567a-14b0-42ce-9fe0-b0fb74249b85', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'serial': 'dfb18055-e5b6-45f8-9efa-a290d1c4dbf2'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:44:24 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:24 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:24 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:24 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:24 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de22f13f-a119-44b8-bfea-a616ea63f8a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:44:24 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53295c72-8f4d-46a3-a979-11cab9264445]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2] added
Nov 14 14:44:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4586b6f-cec0-40fb-a126-f2926d5aaddc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ab8e4b-22e9-4313-ab31-1705925ef9ae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbMxfzrt {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbMxfzrt" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4365d9f8-2c16-49fd-9ef2-d80a4010533a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbMxfzrt'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10007f85-c697-4897-8921-a63127d4b93b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0a01a8-5470-41d7-847a-b236991b39b2]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea6b136-cbed-4eb8-88e9-01602cb98796]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260]
Nov 14 14:44:24 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260] successful.
Nov 14 14:44:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[529b6b97-38de-44a0-88e0-3f4a4939ee8d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1752fb57-58a7-412b-b317-b07dc6af68ce]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:24 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20117d96-d99c-4733-a1dd-4bf351f73dd1]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:44:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26564303966373932', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564303966373932', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4379320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4379320',id=29,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-u57s3mvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:14Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=5399567a-14b0-42ce-9fe0-b0fb74249b85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'pci_devices' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:44:25 user nova-compute[75292]:   <uuid>5399567a-14b0-42ce-9fe0-b0fb74249b85</uuid>
Nov 14 14:44:25 user nova-compute[75292]:   <name>instance-0000001d</name>
Nov 14 14:44:25 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:44:25 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:44:25 user nova-compute[75292]:   <metadata>
Nov 14 14:44:25 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:44:25 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:44:25 user nova-compute[75292]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-4379320</nova:name>
Nov 14 14:44:25 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:44:24</nova:creationTime>
Nov 14 14:44:25 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:44:25 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:44:25 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:44:25 user nova-compute[75292]:       <nova:owner>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:user uuid="38a8da6883ae40c4b12c8c483d598a40">tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member</nova:user>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:project uuid="60ef654d69c34328893549c7a124aebf">tempest-ServerBootFromVolumeStableRescueTest-172724502</nova:project>
Nov 14 14:44:25 user nova-compute[75292]:       </nova:owner>
Nov 14 14:44:25 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:44:25 user nova-compute[75292]:       <nova:ports>
Nov 14 14:44:25 user nova-compute[75292]:         <nova:port uuid="4adea91d-1181-4be9-8723-50283103689f">
Nov 14 14:44:25 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:44:25 user nova-compute[75292]:         </nova:port>
Nov 14 14:44:25 user nova-compute[75292]:       </nova:ports>
Nov 14 14:44:25 user nova-compute[75292]:     </nova:instance>
Nov 14 14:44:25 user nova-compute[75292]:   </metadata>
Nov 14 14:44:25 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:44:25 user nova-compute[75292]:     <system>
Nov 14 14:44:25 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:44:25 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:44:25 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:44:25 user nova-compute[75292]:       <entry name="serial">5399567a-14b0-42ce-9fe0-b0fb74249b85</entry>
Nov 14 14:44:25 user nova-compute[75292]:       <entry name="uuid">5399567a-14b0-42ce-9fe0-b0fb74249b85</entry>
Nov 14 14:44:25 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:44:25 user nova-compute[75292]:     </system>
Nov 14 14:44:25 user nova-compute[75292]:   </sysinfo>
Nov 14 14:44:25 user nova-compute[75292]:   <os>
Nov 14 14:44:25 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:44:25 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:44:25 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:44:25 user nova-compute[75292]:   </os>
Nov 14 14:44:25 user nova-compute[75292]:   <features>
Nov 14 14:44:25 user nova-compute[75292]:     <acpi/>
Nov 14 14:44:25 user nova-compute[75292]:     <apic/>
Nov 14 14:44:25 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:44:25 user nova-compute[75292]:   </features>
Nov 14 14:44:25 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:44:25 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:44:25 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:44:25 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:44:25 user nova-compute[75292]:   </clock>
Nov 14 14:44:25 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:44:25 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:44:25 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:44:25 user nova-compute[75292]:   </cpu>
Nov 14 14:44:25 user nova-compute[75292]:   <devices>
Nov 14 14:44:25 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:44:25 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:44:25 user nova-compute[75292]:       <source dev="/dev/sdd"/>
Nov 14 14:44:25 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:44:25 user nova-compute[75292]:       <serial>dfb18055-e5b6-45f8-9efa-a290d1c4dbf2</serial>
Nov 14 14:44:25 user nova-compute[75292]:     </disk>
Nov 14 14:44:25 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:44:25 user nova-compute[75292]:       <mac address="fa:16:3e:25:f8:ab"/>
Nov 14 14:44:25 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:25 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:44:25 user nova-compute[75292]:       <target dev="tap4adea91d-11"/>
Nov 14 14:44:25 user nova-compute[75292]:     </interface>
Nov 14 14:44:25 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:44:25 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/console.log" append="off"/>
Nov 14 14:44:25 user nova-compute[75292]:     </serial>
Nov 14 14:44:25 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:44:25 user nova-compute[75292]:     <video>
Nov 14 14:44:25 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:25 user nova-compute[75292]:     </video>
Nov 14 14:44:25 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:44:25 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:44:25 user nova-compute[75292]:     </rng>
Nov 14 14:44:25 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:44:25 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:44:25 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:44:25 user nova-compute[75292]:     </memballoon>
Nov 14 14:44:25 user nova-compute[75292]:   </devices>
Nov 14 14:44:25 user nova-compute[75292]: </domain>
Nov 14 14:44:25 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4379320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4379320',id=29,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-u57s3mvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:14Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=5399567a-14b0-42ce-9fe0-b0fb74249b85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG os_vif [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5ec1b1a-0a09-51d8-9f0b-c2d388dd18de', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4adea91d-11, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4adea91d-11, col_values=(('qos', UUID('3d6babc6-2e20-48ec-aeac-bcfa115efd21')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4adea91d-11, col_values=(('external_ids', {'iface-id': '4adea91d-1181-4be9-8723-50283103689f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:f8:ab', 'vm-uuid': '5399567a-14b0-42ce-9fe0-b0fb74249b85'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:25 user nova-compute[75292]: INFO os_vif [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11')
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:44:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No VIF found with MAC fa:16:3e:25:f8:ab, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:44:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-4053dffe-e505-4e90-b56c-6e2b172429a8 req-d4a2ebf3-36bb-413d-948d-17d5c36b5d11 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4053dffe-e505-4e90-b56c-6e2b172429a8 req-d4a2ebf3-36bb-413d-948d-17d5c36b5d11 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4053dffe-e505-4e90-b56c-6e2b172429a8 req-d4a2ebf3-36bb-413d-948d-17d5c36b5d11 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4053dffe-e505-4e90-b56c-6e2b172429a8 req-d4a2ebf3-36bb-413d-948d-17d5c36b5d11 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-4053dffe-e505-4e90-b56c-6e2b172429a8 req-d4a2ebf3-36bb-413d-948d-17d5c36b5d11 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:27 user nova-compute[75292]: WARNING nova.compute.manager [req-4053dffe-e505-4e90-b56c-6e2b172429a8 req-d4a2ebf3-36bb-413d-948d-17d5c36b5d11 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state building and task_state spawning.
Nov 14 14:44:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:44:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance spawned successfully.
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:29 user nova-compute[75292]: INFO nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:44:29 user nova-compute[75292]: INFO nova.compute.manager [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Took 16.80 seconds to build instance.
Nov 14 14:44:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43eada4d-a273-46c4-a5f8-6a51656f0542 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.900s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9c814bfe-c7f9-441d-b82b-abaf5dd83e79 req-aeb35e0f-0c7b-4143-bd7e-2796adb77508 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9c814bfe-c7f9-441d-b82b-abaf5dd83e79 req-aeb35e0f-0c7b-4143-bd7e-2796adb77508 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9c814bfe-c7f9-441d-b82b-abaf5dd83e79 req-aeb35e0f-0c7b-4143-bd7e-2796adb77508 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9c814bfe-c7f9-441d-b82b-abaf5dd83e79 req-aeb35e0f-0c7b-4143-bd7e-2796adb77508 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9c814bfe-c7f9-441d-b82b-abaf5dd83e79 req-aeb35e0f-0c7b-4143-bd7e-2796adb77508 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:29 user nova-compute[75292]: WARNING nova.compute.manager [req-9c814bfe-c7f9-441d-b82b-abaf5dd83e79 req-aeb35e0f-0c7b-4143-bd7e-2796adb77508 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state active and task_state None.
Nov 14 14:44:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-changed-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Refreshing instance network info cache due to event network-changed-4ac54b9d-8973-4c56-be66-971e26ac903d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] Acquiring lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] Acquired lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Refreshing network info cache for port 4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updated VIF entry in instance network info cache for port 4ac54b9d-8973-4c56-be66-971e26ac903d. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating instance_info_cache with network_info: [{"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd3dc84e-0623-4299-b547-e90768857c13 req-d143a46e-9ef8-4c55-8436-94f262c8eb58 service nova] Releasing lock "refresh_cache-50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:38 user nova-compute[75292]: INFO nova.compute.manager [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Rebuilding instance
Nov 14 14:44:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-bee5cc12-305a-439c-acf4-8a12b0d40426 req-8c810f57-5c20-4ca6-9cb5-920c85d69acc service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-unplugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bee5cc12-305a-439c-acf4-8a12b0d40426 req-8c810f57-5c20-4ca6-9cb5-920c85d69acc service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bee5cc12-305a-439c-acf4-8a12b0d40426 req-8c810f57-5c20-4ca6-9cb5-920c85d69acc service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bee5cc12-305a-439c-acf4-8a12b0d40426 req-8c810f57-5c20-4ca6-9cb5-920c85d69acc service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-bee5cc12-305a-439c-acf4-8a12b0d40426 req-8c810f57-5c20-4ca6-9cb5-920c85d69acc service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-unplugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:38 user nova-compute[75292]: WARNING nova.compute.manager [req-bee5cc12-305a-439c-acf4-8a12b0d40426 req-8c810f57-5c20-4ca6-9cb5-920c85d69acc service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-unplugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state active and task_state rebuilding.
Nov 14 14:44:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance destroyed successfully.
Nov 14 14:44:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance destroyed successfully.
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-47796409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1382089811',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXL14FTdkQpYas1YFHEy8DREzMtyxGvJrMS8ayO8pWfev65QDIVokNGzPZgeo0WpVNlhsgFiICYn4UVmFa4qRhuK6ujEEjVfOgf6j7HcOUueH+Tk2hZKJIseF3p+94IJQ==',key_name='tempest-keypair-493871016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ea0f958209e4f098f0636fc392ec717',ramdisk_id='',reservation_id='r-ezdq4bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1287985576',owner_user_name='tempest-ServerActionsV293TestJSON-1287985576-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d907961ca894eaeac999bab8224c2c8',uuid=50b9cfcd-94d5-4efa-9fd5-8553ffb9a052,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converting VIF {"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ac54b9d-89, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1e3d669-53c2-48a9-ab84-ab130318c146) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:39 user nova-compute[75292]: INFO os_vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89')
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:39 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17de74-fdef-4aa0-b1b7-f83e9497485a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:44:39 user nova-compute[75292]: No targets found.
Nov 14 14:44:39 user nova-compute[75292]: iSNS:
Nov 14 14:44:39 user nova-compute[75292]: No targets found.
Nov 14 14:44:39 user nova-compute[75292]: STATIC:
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: FIRMWARE:
Nov 14 14:44:39 user nova-compute[75292]: No targets found.
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:44:39 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:44:39 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af8bdd-116e-4003-9198-6ab09e7fd3f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0df03-f574-4e51-b643-a0552eea3fac]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b540fcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0bafe-2f02-43b6-acb9-59682863c306]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63e8da-2576-4abb-925d-31bcaea6a737]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d67cb1-31d8-4e04-a42a-9758dd862e20]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9cd196-4ce2-4b6d-bae6-23201a931153]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866f4ba-e46e-4b35-b7ec-89aefca0862b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fbdadf-f905-4cee-9dc1-e1bfc19205b5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]
Nov 14 14:44:39 user nova-compute[75292]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[175e1e17-da7c-4637-88bc-09f4c0c8f513]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== disconnect_volume: return (314ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:44:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Deleting instance files /opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052_del
Nov 14 14:44:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Deletion of /opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052_del complete
Nov 14 14:44:39 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 could not be found.
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:39 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05f332-5d6d-48ec-a8e6-a75cd3cdc286]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:44:39 user nova-compute[75292]: No targets found.
Nov 14 14:44:39 user nova-compute[75292]: iSNS:
Nov 14 14:44:39 user nova-compute[75292]: No targets found.
Nov 14 14:44:39 user nova-compute[75292]: STATIC:
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d
Nov 14 14:44:39 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:44:39 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:44:39 user nova-compute[75292]: FIRMWARE:
Nov 14 14:44:39 user nova-compute[75292]: No targets found.
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:44:39 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:44:39 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc212d3c-6e7b-4290-955c-96e0451146d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7182f46f-744e-4719-9a7e-e5c14d72584c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:39 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c297eb0>, {}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Disconnecting from: [] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== disconnect_volume: return (79ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:44:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Preparing to wait for external event volume-reimaged-c72be6cc-e787-4536-b933-b06a88489a94 {{(pid=75292) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-79dec46a-14c8-44b5-b3e5-1ecca7b90156 req-01351155-5f92-4451-91de-14d08b5948bc service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-79dec46a-14c8-44b5-b3e5-1ecca7b90156 req-01351155-5f92-4451-91de-14d08b5948bc service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-79dec46a-14c8-44b5-b3e5-1ecca7b90156 req-01351155-5f92-4451-91de-14d08b5948bc service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-79dec46a-14c8-44b5-b3e5-1ecca7b90156 req-01351155-5f92-4451-91de-14d08b5948bc service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-79dec46a-14c8-44b5-b3e5-1ecca7b90156 req-01351155-5f92-4451-91de-14d08b5948bc service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No event matching network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d in dict_keys([('volume-reimaged', 'c72be6cc-e787-4536-b933-b06a88489a94')]) {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 14:44:40 user nova-compute[75292]: WARNING nova.compute.manager [req-79dec46a-14c8-44b5-b3e5-1ecca7b90156 req-01351155-5f92-4451-91de-14d08b5948bc service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state active and task_state rebuilding.
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:44:41 user nova-compute[75292]: INFO nova.compute.claims [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Claim successful on node user
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:44:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.policy [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e75042706a2347ebba11d20ba65ba282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b7e88c2e88460484f06a772b1f60c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:44:41 user nova-compute[75292]: INFO nova.virt.block_device [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Booting with volume 8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 at /dev/vda
Nov 14 14:44:41 user nova-compute[75292]: DEBUG os_brick.utils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d029ea67-7d17-40e7-ac55-4e135e371698]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09491b3-5767-4fbd-bd2d-19796ee57e0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ede9d87-be2a-470d-b2db-e7ce71249267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea97764-0fa6-489a-abe2-93b06427d012]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:44:41 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:44:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4490d25-d097-4c79-9b64-fcb151a1d6e0]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG os_brick.utils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:41 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating existing volume attachment record: f5b2c123-d787-4be7-9100-828bb68d42ec {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:44:42 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Successfully created port: aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Successfully updated port: aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquired lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-changed-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Refreshing instance network info cache due to event network-changed-aaf2e6af-af4a-4632-95e5-73f7a28ce01e. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] Acquiring lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Releasing lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance network_info: |[{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] Acquired lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:44:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Refreshing network info cache for port aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:44:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:44 user nova-compute[75292]: DEBUG nova.network.neutron [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updated VIF entry in instance network info cache for port aaf2e6af-af4a-4632-95e5-73f7a28ce01e. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:44:44 user nova-compute[75292]: DEBUG nova.network.neutron [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:44:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-839d1038-8aef-4380-a84c-99622cc2e9a4 req-64e8a1d6-a942-4828-a752-cfd4a7444f85 service nova] Releasing lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:44:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:44:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Creating image(s)
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Ensure instance console log exists: /opt/stack/data/nova/instances/45f14d3a-a81c-44f0-921f-0816b4e193bb/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Start _get_guest_xml network_info=[{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f5b2c123-d787-4be7-9100-828bb68d42ec', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45f14d3a-a81c-44f0-921f-0816b4e193bb', 'attached_at': '', 'detached_at': '', 'volume_id': '8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'serial': '8cdefa72-53da-4b8f-ac20-4f0b9fa36b91'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:44:46 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:46 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:46 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:46 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:44:46 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad8e2ee-bd58-4f60-8667-8f340595a94a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:44:46 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d09b9-d0a4-4a6d-aff7-fc7f19506ecf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91] added
Nov 14 14:44:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f9bc82-ce81-43b2-ae1e-83e0a26ccd72]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3380bc81-f589-497a-acd7-17b963ffb068]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjyqmeBc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjyqmeBc" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c954a86-db9e-40f4-b72c-f0d28f962858]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjyqmeBc'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2961a37-fa17-4dac-bd4b-405efd18dde3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7e2252-fd65-4cb8-b1d8-625cc260616d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e67f437-dd27-42ca-9d60-e5dc80880277]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]
Nov 14 14:44:46 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.
Nov 14 14:44:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[762f9a46-fe97-4c74-a88c-dd2b5c2e6e5c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d14e6-88f1-4497-a331-468b522fe5b0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:44:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9943068-7cd3-4523-af35-c70b09413a13]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:44:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26638336463633863', 'path': '/dev/sdf'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638336463633863', 'path': '/dev/sdf'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1090877024',display_name='tempest-ServerActionsTestOtherA-server-1090877024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1090877024',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-khi3cfpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=45f14d3a-a81c-44f0-921f-0816b4e193bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'pci_devices' on Instance uuid 45f14d3a-a81c-44f0-921f-0816b4e193bb {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:44:47 user nova-compute[75292]:   <uuid>45f14d3a-a81c-44f0-921f-0816b4e193bb</uuid>
Nov 14 14:44:47 user nova-compute[75292]:   <name>instance-0000001e</name>
Nov 14 14:44:47 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:44:47 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:44:47 user nova-compute[75292]:   <metadata>
Nov 14 14:44:47 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:44:47 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:44:47 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherA-server-1090877024</nova:name>
Nov 14 14:44:47 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:44:46</nova:creationTime>
Nov 14 14:44:47 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:44:47 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:44:47 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:44:47 user nova-compute[75292]:       <nova:owner>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:user uuid="e75042706a2347ebba11d20ba65ba282">tempest-ServerActionsTestOtherA-1545988335-project-member</nova:user>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:project uuid="54b7e88c2e88460484f06a772b1f60c3">tempest-ServerActionsTestOtherA-1545988335</nova:project>
Nov 14 14:44:47 user nova-compute[75292]:       </nova:owner>
Nov 14 14:44:47 user nova-compute[75292]:       <nova:ports>
Nov 14 14:44:47 user nova-compute[75292]:         <nova:port uuid="aaf2e6af-af4a-4632-95e5-73f7a28ce01e">
Nov 14 14:44:47 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 14:44:47 user nova-compute[75292]:         </nova:port>
Nov 14 14:44:47 user nova-compute[75292]:       </nova:ports>
Nov 14 14:44:47 user nova-compute[75292]:     </nova:instance>
Nov 14 14:44:47 user nova-compute[75292]:   </metadata>
Nov 14 14:44:47 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:44:47 user nova-compute[75292]:     <system>
Nov 14 14:44:47 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:44:47 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:44:47 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:44:47 user nova-compute[75292]:       <entry name="serial">45f14d3a-a81c-44f0-921f-0816b4e193bb</entry>
Nov 14 14:44:47 user nova-compute[75292]:       <entry name="uuid">45f14d3a-a81c-44f0-921f-0816b4e193bb</entry>
Nov 14 14:44:47 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:44:47 user nova-compute[75292]:     </system>
Nov 14 14:44:47 user nova-compute[75292]:   </sysinfo>
Nov 14 14:44:47 user nova-compute[75292]:   <os>
Nov 14 14:44:47 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:44:47 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:44:47 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:44:47 user nova-compute[75292]:   </os>
Nov 14 14:44:47 user nova-compute[75292]:   <features>
Nov 14 14:44:47 user nova-compute[75292]:     <acpi/>
Nov 14 14:44:47 user nova-compute[75292]:     <apic/>
Nov 14 14:44:47 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:44:47 user nova-compute[75292]:   </features>
Nov 14 14:44:47 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:44:47 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:44:47 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:44:47 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:44:47 user nova-compute[75292]:   </clock>
Nov 14 14:44:47 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:44:47 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:44:47 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:44:47 user nova-compute[75292]:   </cpu>
Nov 14 14:44:47 user nova-compute[75292]:   <devices>
Nov 14 14:44:47 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:44:47 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:44:47 user nova-compute[75292]:       <source dev="/dev/sdf"/>
Nov 14 14:44:47 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:44:47 user nova-compute[75292]:       <serial>8cdefa72-53da-4b8f-ac20-4f0b9fa36b91</serial>
Nov 14 14:44:47 user nova-compute[75292]:     </disk>
Nov 14 14:44:47 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:44:47 user nova-compute[75292]:       <mac address="fa:16:3e:7a:7e:8a"/>
Nov 14 14:44:47 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:47 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:44:47 user nova-compute[75292]:       <target dev="tapaaf2e6af-af"/>
Nov 14 14:44:47 user nova-compute[75292]:     </interface>
Nov 14 14:44:47 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:44:47 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/45f14d3a-a81c-44f0-921f-0816b4e193bb/console.log" append="off"/>
Nov 14 14:44:47 user nova-compute[75292]:     </serial>
Nov 14 14:44:47 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:44:47 user nova-compute[75292]:     <video>
Nov 14 14:44:47 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:44:47 user nova-compute[75292]:     </video>
Nov 14 14:44:47 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:44:47 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:44:47 user nova-compute[75292]:     </rng>
Nov 14 14:44:47 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:44:47 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:44:47 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:44:47 user nova-compute[75292]:     </memballoon>
Nov 14 14:44:47 user nova-compute[75292]:   </devices>
Nov 14 14:44:47 user nova-compute[75292]: </domain>
Nov 14 14:44:47 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1090877024',display_name='tempest-ServerActionsTestOtherA-server-1090877024',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1090877024',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-khi3cfpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=45f14d3a-a81c-44f0-921f-0816b4e193bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG os_vif [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9e82803-7677-5f55-939f-e317e0026eaa', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaf2e6af-af, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaaf2e6af-af, col_values=(('qos', UUID('89586c83-7ed1-4d63-b9e7-dcbc66b43f21')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaaf2e6af-af, col_values=(('external_ids', {'iface-id': 'aaf2e6af-af4a-4632-95e5-73f7a28ce01e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:7e:8a', 'vm-uuid': '45f14d3a-a81c-44f0-921f-0816b4e193bb'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:47 user nova-compute[75292]: INFO os_vif [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af')
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:44:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No VIF found with MAC fa:16:3e:7a:7e:8a, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-c4792069-1f18-40b5-a154-10f53115c586 req-01c416ba-7b86-483e-bd5b-75bef943f80c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c4792069-1f18-40b5-a154-10f53115c586 req-01c416ba-7b86-483e-bd5b-75bef943f80c service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c4792069-1f18-40b5-a154-10f53115c586 req-01c416ba-7b86-483e-bd5b-75bef943f80c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c4792069-1f18-40b5-a154-10f53115c586 req-01c416ba-7b86-483e-bd5b-75bef943f80c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-c4792069-1f18-40b5-a154-10f53115c586 req-01c416ba-7b86-483e-bd5b-75bef943f80c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:49 user nova-compute[75292]: WARNING nova.compute.manager [req-c4792069-1f18-40b5-a154-10f53115c586 req-01c416ba-7b86-483e-bd5b-75bef943f80c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state building and task_state spawning.
Nov 14 14:44:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:44:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance spawned successfully.
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-30d849d5-84b5-439b-bf67-f8f1370af131 req-18e121c4-5491-4568-84ea-263335c409f5 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-30d849d5-84b5-439b-bf67-f8f1370af131 req-18e121c4-5491-4568-84ea-263335c409f5 service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-30d849d5-84b5-439b-bf67-f8f1370af131 req-18e121c4-5491-4568-84ea-263335c409f5 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-30d849d5-84b5-439b-bf67-f8f1370af131 req-18e121c4-5491-4568-84ea-263335c409f5 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-30d849d5-84b5-439b-bf67-f8f1370af131 req-18e121c4-5491-4568-84ea-263335c409f5 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:44:51 user nova-compute[75292]: WARNING nova.compute.manager [req-30d849d5-84b5-439b-bf67-f8f1370af131 req-18e121c4-5491-4568-84ea-263335c409f5 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state building and task_state spawning.
Nov 14 14:44:51 user nova-compute[75292]: INFO nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 14 14:44:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:44:51 user nova-compute[75292]: INFO nova.compute.manager [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Took 10.45 seconds to build instance.
Nov 14 14:44:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a5159af5-8fb9-41f6-9137-73c725a37165 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.679s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 req-8361efa0-eb8c-473e-97d9-a34697050bd8 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event volume-reimaged-c72be6cc-e787-4536-b933-b06a88489a94 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 req-8361efa0-eb8c-473e-97d9-a34697050bd8 service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 req-8361efa0-eb8c-473e-97d9-a34697050bd8 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 req-8361efa0-eb8c-473e-97d9-a34697050bd8 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 req-8361efa0-eb8c-473e-97d9-a34697050bd8 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Processing event volume-reimaged-c72be6cc-e787-4536-b933-b06a88489a94 {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:44:56 user nova-compute[75292]: INFO nova.virt.block_device [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Booting with volume c72be6cc-e787-4536-b933-b06a88489a94 at /dev/vda
Nov 14 14:44:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[44377a67-1b6c-4aad-ad81-c437c74bae29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a243ce9-1d17-4526-b417-a1cdec4c4d94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a666ba-9d3b-4d5a-94f6-28695964cba9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[531fef03-8fb3-439b-9381-b1c0565a291a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:44:56 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:44:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc226e-39ba-4d2b-b41e-70c585f71f1b]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:44:56 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating existing volume attachment record: a929bb99-9c8c-402a-977a-f44b891117e8 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:44:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:45:00 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Creating image(s)
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Ensure instance console log exists: /opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Start _get_guest_xml network_info=[{"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a929bb99-9c8c-402a-977a-f44b891117e8', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50b9cfcd-94d5-4efa-9fd5-8553ffb9a052', 'attached_at': '', 'detached_at': '', 'volume_id': 'c72be6cc-e787-4536-b933-b06a88489a94', 'serial': 'c72be6cc-e787-4536-b933-b06a88489a94'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:45:00 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 14:45:00 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:45:00 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:45:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:45:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:45:01 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbdae75-f3bd-4e8f-b7ab-65c3f889558f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:45:01 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa80ee-f378-41e7-b66e-b9d5896fd907]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94] added
Nov 14 14:45:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48830e1b-3c7a-4a20-a44e-518301ed4edd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f635de11-bff2-4058-a99a-c03c0724fb57]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UonbBYgr {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UonbBYgr" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eede57-6517-4c2d-a9da-b389502f3ee2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UonbBYgr'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d759242d-81f7-458c-af9b-9d418555516c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402664f-1aaf-479a-8336-97f5a9c4210d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31bd943-c25c-4372-8a6a-137f73b70098]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]
Nov 14 14:45:01 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.
Nov 14 14:45:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd9cf6-2a22-441c-b671-0f3d17df2e5e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb9182d-09c2-484f-97c4-e04f2f29e60d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a947c83e-aa3c-4c1c-ac42-c729a7130603]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26639386234666635', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639386234666635', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-47796409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1382089811',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXL14FTdkQpYas1YFHEy8DREzMtyxGvJrMS8ayO8pWfev65QDIVokNGzPZgeo0WpVNlhsgFiICYn4UVmFa4qRhuK6ujEEjVfOgf6j7HcOUueH+Tk2hZKJIseF3p+94IJQ==',key_name='tempest-keypair-493871016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ea0f958209e4f098f0636fc392ec717',ramdisk_id='',reservation_id='r-ezdq4bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1287985576',owner_user_name='tempest-ServerActionsV293TestJSON-1287985576-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d907961ca894eaeac999bab8224c2c8',uuid=50b9cfcd-94d5-4efa-9fd5-8553ffb9a052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converting VIF {"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:45:02 user nova-compute[75292]:   <uuid>50b9cfcd-94d5-4efa-9fd5-8553ffb9a052</uuid>
Nov 14 14:45:02 user nova-compute[75292]:   <name>instance-0000001a</name>
Nov 14 14:45:02 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:45:02 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:45:02 user nova-compute[75292]:   <metadata>
Nov 14 14:45:02 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:45:02 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:45:02 user nova-compute[75292]:       <nova:name>tempest-ServerActionsV293TestJSON-server-47796409</nova:name>
Nov 14 14:45:02 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:45:00</nova:creationTime>
Nov 14 14:45:02 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:45:02 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:45:02 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:45:02 user nova-compute[75292]:       <nova:owner>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:user uuid="8d907961ca894eaeac999bab8224c2c8">tempest-ServerActionsV293TestJSON-1287985576-project-member</nova:user>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:project uuid="1ea0f958209e4f098f0636fc392ec717">tempest-ServerActionsV293TestJSON-1287985576</nova:project>
Nov 14 14:45:02 user nova-compute[75292]:       </nova:owner>
Nov 14 14:45:02 user nova-compute[75292]:       <nova:ports>
Nov 14 14:45:02 user nova-compute[75292]:         <nova:port uuid="4ac54b9d-8973-4c56-be66-971e26ac903d">
Nov 14 14:45:02 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:45:02 user nova-compute[75292]:         </nova:port>
Nov 14 14:45:02 user nova-compute[75292]:       </nova:ports>
Nov 14 14:45:02 user nova-compute[75292]:     </nova:instance>
Nov 14 14:45:02 user nova-compute[75292]:   </metadata>
Nov 14 14:45:02 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:45:02 user nova-compute[75292]:     <system>
Nov 14 14:45:02 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:45:02 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:45:02 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:45:02 user nova-compute[75292]:       <entry name="serial">50b9cfcd-94d5-4efa-9fd5-8553ffb9a052</entry>
Nov 14 14:45:02 user nova-compute[75292]:       <entry name="uuid">50b9cfcd-94d5-4efa-9fd5-8553ffb9a052</entry>
Nov 14 14:45:02 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:45:02 user nova-compute[75292]:     </system>
Nov 14 14:45:02 user nova-compute[75292]:   </sysinfo>
Nov 14 14:45:02 user nova-compute[75292]:   <os>
Nov 14 14:45:02 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:45:02 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:45:02 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:45:02 user nova-compute[75292]:   </os>
Nov 14 14:45:02 user nova-compute[75292]:   <features>
Nov 14 14:45:02 user nova-compute[75292]:     <acpi/>
Nov 14 14:45:02 user nova-compute[75292]:     <apic/>
Nov 14 14:45:02 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:45:02 user nova-compute[75292]:   </features>
Nov 14 14:45:02 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:45:02 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:45:02 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:45:02 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:45:02 user nova-compute[75292]:   </clock>
Nov 14 14:45:02 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:45:02 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:45:02 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:45:02 user nova-compute[75292]:   </cpu>
Nov 14 14:45:02 user nova-compute[75292]:   <devices>
Nov 14 14:45:02 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:45:02 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:45:02 user nova-compute[75292]:       <source dev="/dev/sde"/>
Nov 14 14:45:02 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:45:02 user nova-compute[75292]:       <serial>c72be6cc-e787-4536-b933-b06a88489a94</serial>
Nov 14 14:45:02 user nova-compute[75292]:     </disk>
Nov 14 14:45:02 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:45:02 user nova-compute[75292]:       <mac address="fa:16:3e:3b:ee:2f"/>
Nov 14 14:45:02 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:45:02 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:45:02 user nova-compute[75292]:       <target dev="tap4ac54b9d-89"/>
Nov 14 14:45:02 user nova-compute[75292]:     </interface>
Nov 14 14:45:02 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:45:02 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052/console.log" append="off"/>
Nov 14 14:45:02 user nova-compute[75292]:     </serial>
Nov 14 14:45:02 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:45:02 user nova-compute[75292]:     <video>
Nov 14 14:45:02 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:45:02 user nova-compute[75292]:     </video>
Nov 14 14:45:02 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:45:02 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:45:02 user nova-compute[75292]:     </rng>
Nov 14 14:45:02 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:45:02 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:45:02 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:45:02 user nova-compute[75292]:     </memballoon>
Nov 14 14:45:02 user nova-compute[75292]:   </devices>
Nov 14 14:45:02 user nova-compute[75292]: </domain>
Nov 14 14:45:02 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-47796409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1382089811',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXL14FTdkQpYas1YFHEy8DREzMtyxGvJrMS8ayO8pWfev65QDIVokNGzPZgeo0WpVNlhsgFiICYn4UVmFa4qRhuK6ujEEjVfOgf6j7HcOUueH+Tk2hZKJIseF3p+94IJQ==',key_name='tempest-keypair-493871016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:42:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1ea0f958209e4f098f0636fc392ec717',ramdisk_id='',reservation_id='r-ezdq4bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1287985576',owner_user_name='tempest-ServerActionsV293TestJSON-1287985576-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d907961ca894eaeac999bab8224c2c8',uuid=50b9cfcd-94d5-4efa-9fd5-8553ffb9a052,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converting VIF {"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG os_vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29617855-b3ce-51ab-b0e0-b514880ae2f3', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ac54b9d-89, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ac54b9d-89, col_values=(('qos', UUID('ba4d7c77-9d29-47e2-9769-053dc4d84a51')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ac54b9d-89, col_values=(('external_ids', {'iface-id': '4ac54b9d-8973-4c56-be66-971e26ac903d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ee:2f', 'vm-uuid': '50b9cfcd-94d5-4efa-9fd5-8553ffb9a052'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:02 user nova-compute[75292]: INFO os_vif [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89')
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:45:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] No VIF found with MAC fa:16:3e:3b:ee:2f, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:45:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-8d05bfdf-b3e4-4e6a-a51e-aae99f4fd1e3 req-b15565da-892b-4fb4-b801-0181212b34c1 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8d05bfdf-b3e4-4e6a-a51e-aae99f4fd1e3 req-b15565da-892b-4fb4-b801-0181212b34c1 service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8d05bfdf-b3e4-4e6a-a51e-aae99f4fd1e3 req-b15565da-892b-4fb4-b801-0181212b34c1 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8d05bfdf-b3e4-4e6a-a51e-aae99f4fd1e3 req-b15565da-892b-4fb4-b801-0181212b34c1 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-8d05bfdf-b3e4-4e6a-a51e-aae99f4fd1e3 req-b15565da-892b-4fb4-b801-0181212b34c1 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:04 user nova-compute[75292]: WARNING nova.compute.manager [req-8d05bfdf-b3e4-4e6a-a51e-aae99f4fd1e3 req-b15565da-892b-4fb4-b801-0181212b34c1 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state active and task_state rebuild_spawning.
Nov 14 14:45:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:45:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance spawned successfully.
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:45:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-d9f14f7f-7926-476a-974c-d44c9dad0ae3 req-cce6e081-b1e6-4adf-81fa-d6f7b99e2918 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d9f14f7f-7926-476a-974c-d44c9dad0ae3 req-cce6e081-b1e6-4adf-81fa-d6f7b99e2918 service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d9f14f7f-7926-476a-974c-d44c9dad0ae3 req-cce6e081-b1e6-4adf-81fa-d6f7b99e2918 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d9f14f7f-7926-476a-974c-d44c9dad0ae3 req-cce6e081-b1e6-4adf-81fa-d6f7b99e2918 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-d9f14f7f-7926-476a-974c-d44c9dad0ae3 req-cce6e081-b1e6-4adf-81fa-d6f7b99e2918 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:06 user nova-compute[75292]: WARNING nova.compute.manager [req-d9f14f7f-7926-476a-974c-d44c9dad0ae3 req-cce6e081-b1e6-4adf-81fa-d6f7b99e2918 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state active and task_state rebuild_spawning.
Nov 14 14:45:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75292) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 14:45:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e3865bf-6614-45f3-a7e1-6e9f1508f515 tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:45:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:45:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:45:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:45:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Updating instance_info_cache with network_info: [{"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:45:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c5a143c2-8994-4297-91b2-b64ffa4e77f7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:45:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:45:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:12 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:45:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:45:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7502MB free_disk=25.314773559570312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c5a143c2-8994-4297-91b2-b64ffa4e77f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a7678b53-9d02-4504-97a5-8a92be22318c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7c9e6047-c647-4120-b74a-f62925f5849b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 45f14d3a-a81c-44f0-921f-0816b4e193bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:45:16 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:45:17 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:45:17 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:45:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:45:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:45:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:45:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:30 user nova-compute[75292]: INFO nova.compute.manager [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Unrescuing
Nov 14 14:45:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:45:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:45:30 user nova-compute[75292]: DEBUG nova.network.neutron [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG nova.network.neutron [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'flavor' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-bf71f3e5-a44e-466a-bfac-c1f8e0e78385 req-bb775360-f101-42cf-a3c4-438618feb0f1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf71f3e5-a44e-466a-bfac-c1f8e0e78385 req-bb775360-f101-42cf-a3c4-438618feb0f1 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf71f3e5-a44e-466a-bfac-c1f8e0e78385 req-bb775360-f101-42cf-a3c4-438618feb0f1 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf71f3e5-a44e-466a-bfac-c1f8e0e78385 req-bb775360-f101-42cf-a3c4-438618feb0f1 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-bf71f3e5-a44e-466a-bfac-c1f8e0e78385 req-bb775360-f101-42cf-a3c4-438618feb0f1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:31 user nova-compute[75292]: WARNING nova.compute.manager [req-bf71f3e5-a44e-466a-bfac-c1f8e0e78385 req-bb775360-f101-42cf-a3c4-438618feb0f1 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:45:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:31 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance destroyed successfully.
Nov 14 14:45:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:33 user nova-compute[75292]: WARNING nova.compute.manager [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:45:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:33 user nova-compute[75292]: WARNING nova.compute.manager [req-089ca4c8-48b0-4657-8ba8-8cf5c56a7d1a req-33682cfe-8744-4f26-a43d-3bc55a55b164 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:45:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-c712e128-d024-4e1d-94b8-1c7c03ec840a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:45:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-5a1f0b1d-8b18-449a-a6d7-93f701f86ba7 req-ae74e0bb-5f6f-4661-bfa9-9de31d1c7dee service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5a1f0b1d-8b18-449a-a6d7-93f701f86ba7 req-ae74e0bb-5f6f-4661-bfa9-9de31d1c7dee service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5a1f0b1d-8b18-449a-a6d7-93f701f86ba7 req-ae74e0bb-5f6f-4661-bfa9-9de31d1c7dee service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5a1f0b1d-8b18-449a-a6d7-93f701f86ba7 req-ae74e0bb-5f6f-4661-bfa9-9de31d1c7dee service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-5a1f0b1d-8b18-449a-a6d7-93f701f86ba7 req-ae74e0bb-5f6f-4661-bfa9-9de31d1c7dee service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:35 user nova-compute[75292]: WARNING nova.compute.manager [req-5a1f0b1d-8b18-449a-a6d7-93f701f86ba7 req-ae74e0bb-5f6f-4661-bfa9-9de31d1c7dee service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state active and task_state None.
Nov 14 14:45:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing instance network info cache due to event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:45:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:45:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:45:47 user nova-compute[75292]: DEBUG nova.network.neutron [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:45:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updated VIF entry in instance network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:45:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:45:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2deb1ee8-5abb-4684-a8f2-45dd0da886c4 req-12d4b625-f586-4181-90f9-de6881339f43 service nova] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:49 user nova-compute[75292]: INFO nova.compute.manager [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Shelve offloading
Nov 14 14:45:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-f59ef43e-a238-47c5-ace3-77385e34c770 req-734d9f90-e1b7-462b-8ca5-b8a31b8f4b3e service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-unplugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f59ef43e-a238-47c5-ace3-77385e34c770 req-734d9f90-e1b7-462b-8ca5-b8a31b8f4b3e service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f59ef43e-a238-47c5-ace3-77385e34c770 req-734d9f90-e1b7-462b-8ca5-b8a31b8f4b3e service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f59ef43e-a238-47c5-ace3-77385e34c770 req-734d9f90-e1b7-462b-8ca5-b8a31b8f4b3e service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-f59ef43e-a238-47c5-ace3-77385e34c770 req-734d9f90-e1b7-462b-8ca5-b8a31b8f4b3e service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-unplugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:49 user nova-compute[75292]: WARNING nova.compute.manager [req-f59ef43e-a238-47c5-ace3-77385e34c770 req-734d9f90-e1b7-462b-8ca5-b8a31b8f4b3e service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-unplugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state active and task_state shelving.
Nov 14 14:45:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:50 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance destroyed successfully.
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:45:50 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance destroyed successfully.
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'resources' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-868401689',display_name='tempest-TestShelveInstance-server-868401689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-868401689',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqjTyffMIw4MlE/BwkaOu7XIGIxkb5xs4EfszFIY6DNyGFuKvjQd6pdmU4qfiIAciBA9FVqY7s+vUx2ut01uwn4K4iy3jTixAifs6BEuGHCmcoaAYINj00+tjDpox9+/A==',key_name='tempest-TestShelveInstance-528629411',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e25e4a841b86434196bfdab20c1d3d98',ramdisk_id='',reservation_id='r-59hu8x2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-395501576',owner_user_name='tempest-TestShelveInstance-395501576-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:44:07Z,user_data=None,user_id='2f4a3c09bab1412dbb88bcbe9d90b120',uuid=7c9e6047-c647-4120-b74a-f62925f5849b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converting VIF {"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_vif [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2bb8e3-d3, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing instance network info cache due to event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.network.neutron [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89e46409-15ca-4849-8b01-4c1e7b58d24f) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:45:50 user nova-compute[75292]: INFO os_vif [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3')
Nov 14 14:45:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:45:50 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ac86e8-36e0-4b3e-b8ff-0cb6b57df444]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:45:50 user nova-compute[75292]: No targets found.
Nov 14 14:45:50 user nova-compute[75292]: iSNS:
Nov 14 14:45:50 user nova-compute[75292]: No targets found.
Nov 14 14:45:50 user nova-compute[75292]: STATIC:
Nov 14 14:45:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:45:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:45:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:45:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94
Nov 14 14:45:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:45:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:45:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:45:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:45:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:45:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:45:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:45:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:45:50 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d
Nov 14 14:45:50 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:45:50 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:45:50 user nova-compute[75292]: FIRMWARE:
Nov 14 14:45:50 user nova-compute[75292]: No targets found.
Nov 14 14:45:50 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:45:50 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:45:50 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8790bf-ba9a-407a-8262-f5bbbd2b01fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[566c0824-e8e3-4a4f-9471-871cf470faf6]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:51 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c1a2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d6bbd-4e9f-4b1d-aadf-e26a2b779200]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c059f44-489d-462e-ae56-01ec792edd94]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fbbafd-4a68-468e-8607-8c05b60eacc6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b0c136-8b6f-48ae-8f84-3d7ce2ef5923]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c19edb-ea58-4645-904c-21f04171e5fa]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bb438c-177d-4b44-ab64-5b61f0566bc2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]
Nov 14 14:45:51 user nova-compute[75292]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.
Nov 14 14:45:51 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b9466-0f40-4bcc-96ce-6b9f72b95eca]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] <== disconnect_volume: return (292ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:45:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Deleting instance files /opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b_del
Nov 14 14:45:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Deletion of /opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b_del complete
Nov 14 14:45:51 user nova-compute[75292]: DEBUG nova.network.neutron [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updated VIF entry in instance network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG nova.network.neutron [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": null, "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9819af8d-4f31-49a5-8cbb-0a6b82c859f2 req-92d06646-0a33-440f-a125-972029862675 service nova] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-b1f55eb6-a683-4ee4-ac8b-dd89b292ff95 req-a98de744-6c4b-49db-9e0f-f74be7945ae8 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b1f55eb6-a683-4ee4-ac8b-dd89b292ff95 req-a98de744-6c4b-49db-9e0f-f74be7945ae8 service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b1f55eb6-a683-4ee4-ac8b-dd89b292ff95 req-a98de744-6c4b-49db-9e0f-f74be7945ae8 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b1f55eb6-a683-4ee4-ac8b-dd89b292ff95 req-a98de744-6c4b-49db-9e0f-f74be7945ae8 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-b1f55eb6-a683-4ee4-ac8b-dd89b292ff95 req-a98de744-6c4b-49db-9e0f-f74be7945ae8 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:45:51 user nova-compute[75292]: WARNING nova.compute.manager [req-b1f55eb6-a683-4ee4-ac8b-dd89b292ff95 req-a98de744-6c4b-49db-9e0f-f74be7945ae8 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state active and task_state shelving.
Nov 14 14:45:52 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Deleted allocations for instance 7c9e6047-c647-4120-b74a-f62925f5849b
Nov 14 14:45:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG nova.objects.base [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Object Instance<7c9e6047-c647-4120-b74a-f62925f5849b> lazy-loaded attributes: resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1793bcdf-aab9-4194-9519-bfd5b4406aa3 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.702s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG nova.objects.instance [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'flavor' on Instance uuid 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:45:53 user nova-compute[75292]: INFO nova.compute.manager [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Attaching volume 9d7f7727-a728-4bca-8e09-6d3c66d1c724 to /dev/vdb
Nov 14 14:45:53 user nova-compute[75292]: DEBUG os_brick.utils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a34c21c-ff49-466a-afd8-6352cc0cddc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de64f37-0557-4ca6-ae14-01d72f052b3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95e34e-cd68-47dc-b162-aa771bc31975]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14f7034-9928-4ded-8cc3-9e959a6dca9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:45:53 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:45:53 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[19565823-6326-44c3-9cb9-1cc4f3974af8]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG os_brick.utils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:45:53 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating existing volume attachment record: a65a3dca-2098-40e0-bd9f-00c7ef1b6149 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:45:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJQhLBbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:45:58 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:45:58 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:45:58 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91208f5a-0011-4f4b-b643-c83e383971a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:45:58 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0507a893-4be3-4afe-9988-9f1965a71d29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724] added
Nov 14 14:45:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dfc85c-7799-4a52-8b71-0ee6a3b98f32]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a99dac-3a5c-4abc-ba39-2b30f2bce708]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJQhLBbf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HJQhLBbf" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[33476339-d599-43a4-a446-09666581146c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HJQhLBbf'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[158473be-84d1-4cab-97ec-b91a398796c1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba57ce9-b848-45e3-b298-eca886861dc0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba7d35f-83e0-42f6-bbbb-39487787b632]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260]
Nov 14 14:45:58 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260] successful.
Nov 14 14:45:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d1092-55ed-4cf9-b5ac-b8b45bfa461f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2ea8a-4fe5-4515-86c8-bf52496a747e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:45:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[052fe734-5730-42fa-8064-edcb2b6b941e]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:45:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJQhLBbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23064386137373565', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064386137373565', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG nova.objects.instance [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'flavor' on Instance uuid 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:45:59 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:45:59 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:45:59 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:45:59 user nova-compute[75292]:   <serial>9d7f7727-a728-4bca-8e09-6d3c66d1c724</serial>
Nov 14 14:45:59 user nova-compute[75292]: </disk>
Nov 14 14:45:59 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:45:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] No VIF found with MAC fa:16:3e:92:18:94, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:46:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-77e15e70-41e8-4640-8da4-36e66cb080d2 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.366s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing instance network info cache due to event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:46:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:46:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updated VIF entry in instance network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:46:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8ae44e37-c308-4412-96dd-a35cd6ddd223 req-9410b6c8-e2f3-4dde-81cd-76c776498a1c service nova] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:03 user nova-compute[75292]: INFO nova.compute.manager [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Rescuing
Nov 14 14:46:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd9290a2-9c90-402f-802e-1225cc571c7a req-1f4553b4-def3-46ee-83fb-24d5cb78f079 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd9290a2-9c90-402f-802e-1225cc571c7a req-1f4553b4-def3-46ee-83fb-24d5cb78f079 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd9290a2-9c90-402f-802e-1225cc571c7a req-1f4553b4-def3-46ee-83fb-24d5cb78f079 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd9290a2-9c90-402f-802e-1225cc571c7a req-1f4553b4-def3-46ee-83fb-24d5cb78f079 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd9290a2-9c90-402f-802e-1225cc571c7a req-1f4553b4-def3-46ee-83fb-24d5cb78f079 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:03 user nova-compute[75292]: WARNING nova.compute.manager [req-fd9290a2-9c90-402f-802e-1225cc571c7a req-1f4553b4-def3-46ee-83fb-24d5cb78f079 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state active and task_state rescuing.
Nov 14 14:46:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing instance network info cache due to event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:46:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance destroyed successfully.
Nov 14 14:46:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Attempting a stable device rescue
Nov 14 14:46:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75292) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:46:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Creating image(s)
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "/opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "ea03d8a03630b02fc58f9dcfea1316de20cf0bc9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "ea03d8a03630b02fc58f9dcfea1316de20cf0bc9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:05 user nova-compute[75292]: INFO nova.compute.manager [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Rebooting instance
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:05 user nova-compute[75292]: INFO nova.compute.manager [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Terminating instance
Nov 14 14:46:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG nova.virt.images [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] 6054d0f1-1610-4e5d-ad94-87c564c445b9 was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.part /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-a47d08c7-fbe2-476c-9dea-d0a8b9ffaf75 req-dc7214ef-c1c8-4863-8e17-0d8237d04ff0 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a47d08c7-fbe2-476c-9dea-d0a8b9ffaf75 req-dc7214ef-c1c8-4863-8e17-0d8237d04ff0 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a47d08c7-fbe2-476c-9dea-d0a8b9ffaf75 req-dc7214ef-c1c8-4863-8e17-0d8237d04ff0 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a47d08c7-fbe2-476c-9dea-d0a8b9ffaf75 req-dc7214ef-c1c8-4863-8e17-0d8237d04ff0 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-a47d08c7-fbe2-476c-9dea-d0a8b9ffaf75 req-dc7214ef-c1c8-4863-8e17-0d8237d04ff0 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:05 user nova-compute[75292]: WARNING nova.compute.manager [req-a47d08c7-fbe2-476c-9dea-d0a8b9ffaf75 req-dc7214ef-c1c8-4863-8e17-0d8237d04ff0 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state active and task_state rescuing.
Nov 14 14:46:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-e745da5e-7a8a-48ff-9923-735960dc7270 req-c3be6f8a-e220-4cba-90d4-fb8962e2e192 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-vif-unplugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e745da5e-7a8a-48ff-9923-735960dc7270 req-c3be6f8a-e220-4cba-90d4-fb8962e2e192 service nova] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e745da5e-7a8a-48ff-9923-735960dc7270 req-c3be6f8a-e220-4cba-90d4-fb8962e2e192 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e745da5e-7a8a-48ff-9923-735960dc7270 req-c3be6f8a-e220-4cba-90d4-fb8962e2e192 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-e745da5e-7a8a-48ff-9923-735960dc7270 req-c3be6f8a-e220-4cba-90d4-fb8962e2e192 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] No waiting events found dispatching network-vif-unplugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.compute.manager [req-e745da5e-7a8a-48ff-9923-735960dc7270 req-c3be6f8a-e220-4cba-90d4-fb8962e2e192 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-vif-unplugged-c8de9946-2e06-4bab-853a-808befc4ef9e for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.part /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.converted" returned: 0 in 0.298s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updated VIF entry in instance network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3c286dcf-2f42-47a4-b1a4-5a7b3df47a01 req-33629276-2851-4575-b704-f866127528db service nova] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "ea03d8a03630b02fc58f9dcfea1316de20cf0bc9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.936s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "ea03d8a03630b02fc58f9dcfea1316de20cf0bc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "ea03d8a03630b02fc58f9dcfea1316de20cf0bc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Instance destroyed successfully.
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lazy-loading 'resources' on Instance uuid c5a143c2-8994-4297-91b2-b64ffa4e77f7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-505661428',display_name='tempest-ServersNegativeTestJSON-server-505661428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-505661428',id=18,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444dc84dbece41c6b22a37008eeb40e6',ramdisk_id='',reservation_id='r-89iq04tz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1575597503',owner_user_name='tempest-ServersNegativeTestJSON-1575597503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:37:32Z,user_data=None,user_id='533cc5752e5b4fe2b9b2f2b91bd4259a',uuid=c5a143c2-8994-4297-91b2-b64ffa4e77f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converting VIF {"id": "c8de9946-2e06-4bab-853a-808befc4ef9e", "address": "fa:16:3e:da:73:a8", "network": {"id": "55b6a054-dea9-43df-821d-258910b7e50b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-476356164-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444dc84dbece41c6b22a37008eeb40e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8de9946-2e", "ovs_interfaceid": "c8de9946-2e06-4bab-853a-808befc4ef9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_vif [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8de9946-2e, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9,backing_fmt=raw /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10ced2c1-40a6-44fa-a03f-17b593f806c4) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9,backing_fmt=raw /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue" returned: 0 in 0.048s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "ea03d8a03630b02fc58f9dcfea1316de20cf0bc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'migration_context' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:06 user nova-compute[75292]: INFO os_vif [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:73:a8,bridge_name='br-int',has_traffic_filtering=True,id=c8de9946-2e06-4bab-853a-808befc4ef9e,network=Network(55b6a054-dea9-43df-821d-258910b7e50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8de9946-2e')
Nov 14 14:46:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Deleting instance files /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7_del
Nov 14 14:46:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Deletion of /opt/stack/data/nova/instances/c5a143c2-8994-4297-91b2-b64ffa4e77f7_del complete
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<5399567a-14b0-42ce-9fe0-b0fb74249b85> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Start _get_guest_xml network_info=[{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "vif_mac": "fa:16:3e:25:f8:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6054d0f1-1610-4e5d-ad94-87c564c445b9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c1a6579-e464-4d05-a66f-9c3db5a8af77', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5399567a-14b0-42ce-9fe0-b0fb74249b85', 'attached_at': '', 'detached_at': '', 'volume_id': 'dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'serial': 'dfb18055-e5b6-45f8-9efa-a290d1c4dbf2'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'resources' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<5399567a-14b0-42ce-9fe0-b0fb74249b85> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'numa_topology' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<5399567a-14b0-42ce-9fe0-b0fb74249b85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:46:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:46:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<5399567a-14b0-42ce-9fe0-b0fb74249b85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:46:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:46:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:46:06 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: INFO nova.compute.manager [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56fe9f8-2c27-4d11-abee-2b35d1d2a545]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NbMxfzrt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 14:46:06 user nova-compute[75292]: node.name = iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:46:06 user nova-compute[75292]: node.tpgt = -1
Nov 14 14:46:06 user nova-compute[75292]: node.startup = automatic
Nov 14 14:46:06 user nova-compute[75292]: node.leading_login = No
Nov 14 14:46:06 user nova-compute[75292]: iface.iscsi_ifacename = default
Nov 14 14:46:06 user nova-compute[75292]: iface.net_ifacename = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.ipaddress = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.prefix_len = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.hwaddress = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.transport_name = tcp
Nov 14 14:46:06 user nova-compute[75292]: iface.initiatorname = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.vlan_id = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.vlan_priority = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.vlan_state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.iface_num = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.mtu = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.port = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.bootproto = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.subnet_mask = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.gateway = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_alt_client_id = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_dns = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_learn_iqn = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_vendor_id_state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_vendor_id = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.dhcp_slp_da = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.fragmentation = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.gratuitous_arp = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.incoming_forwarding = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.tos_state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.tos = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.ttl = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.delayed_ack = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.tcp_nagle = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.tcp_wsf_state = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.tcp_wsf = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.tcp_timer_scale = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.tcp_timestamp = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.redirect = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.def_task_mgmt_timeout = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.header_digest = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.data_digest = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.immediate_data = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.initial_r2t = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.data_seq_inorder = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.data_pdu_inorder = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.erl = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.max_receive_data_len = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.first_burst_len = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.max_outstanding_r2t = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.max_burst_len = 0
Nov 14 14:46:06 user nova-compute[75292]: iface.chap_auth = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.bidi_chap = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.strict_login_compliance = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.discovery_auth = <empty>
Nov 14 14:46:06 user nova-compute[75292]: iface.discovery_logout = <empty>
Nov 14 14:46:06 user nova-compute[75292]: node.discovery_address = <empty>
Nov 14 14:46:06 user nova-compute[75292]: node.discovery_port = 0
Nov 14 14:46:06 user nova-compute[75292]: node.discovery_type = static
Nov 14 14:46:06 user nova-compute[75292]: node.session.initial_cmdsn = 0
Nov 14 14:46:06 user nova-compute[75292]: node.session.initial_login_retry_max = 8
Nov 14 14:46:06 user nova-compute[75292]: node.session.xmit_thread_priority = -20
Nov 14 14:46:06 user nova-compute[75292]: node.session.cmds_max = 128
Nov 14 14:46:06 user nova-compute[75292]: node.session.queue_depth = 32
Nov 14 14:46:06 user nova-compute[75292]: node.session.nr_sessions = 1
Nov 14 14:46:06 user nova-compute[75292]: node.session.auth.authmethod = CHAP
Nov 14 14:46:06 user nova-compute[75292]: node.session.auth.username = NbMxfzrt
Nov 14 14:46:06 user nova-compute[75292]: node.session.auth.password = ***
Nov 14 14:46:06 user nova-compute[75292]: node.session.auth.username_in = <empty>
Nov 14 14:46:06 user nova-compute[75292]: node.session.auth.password_in = <empty>
Nov 14 14:46:06 user nova-compute[75292]: node.session.auth.chap_algs = MD5
Nov 14 14:46:06 user nova-compute[75292]: node.session.timeo.replacement_timeout = 120
Nov 14 14:46:06 user nova-compute[75292]: node.session.err_timeo.abort_timeout = 15
Nov 14 14:46:06 user nova-compute[75292]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 14:46:06 user nova-compute[75292]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 14:46:06 user nova-compute[75292]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.FastAbort = Yes
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.InitialR2T = No
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.ImmediateData = Yes
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.MaxConnections = 1
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 14:46:06 user nova-compute[75292]: node.session.iscsi.ERL = 0
Nov 14 14:46:06 user nova-compute[75292]: node.session.scan = manual
Nov 14 14:46:06 user nova-compute[75292]: node.session.reopen_max = 0
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].address = 172.16.0.220
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].port = 3260
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].startup = manual
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].tcp.window_size = 524288
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].tcp.type_of_service = 0
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].timeo.logout_timeout = 15
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].timeo.login_timeout = 15
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].timeo.auth_timeout = 45
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].iscsi.DataDigest = None
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].iscsi.IFMarker = No
Nov 14 14:46:06 user nova-compute[75292]: node.conn[0].iscsi.OFMarker = No
Nov 14 14:46:06 user nova-compute[75292]: # END RECORD
Nov 14 14:46:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d84bbe-8c0c-4a3f-90e3-b08fa5dc98ab]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6371a225-61e5-42b1-9816-44fe3d58a6c8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbMxfzrt {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbMxfzrt" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e824f49f-576c-4891-b9f5-8903c52f660b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbMxfzrt'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c96de2-fb9f-43e0-8401-02324d449a7e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cf2dea-e1fb-4d50-bd95-8e9a3ed24ce7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] HCTL ('35', '0', '0', 0) found on session 34 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b74c1f2-ad68-4c9c-96f8-4f2903e4eec5]: (4, ('0 0 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching for a device in session 34 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== connect_volume: return (172ms) {'type': 'block', 'scsi_wwn': '26564303966373932', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564303966373932', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4379320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4379320',id=29,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-u57s3mvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:44:29Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=5399567a-14b0-42ce-9fe0-b0fb74249b85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "vif_mac": "fa:16:3e:25:f8:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "vif_mac": "fa:16:3e:25:f8:ab"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'pci_devices' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.objects.base [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<5399567a-14b0-42ce-9fe0-b0fb74249b85> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:46:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:46:06 user nova-compute[75292]:   <uuid>5399567a-14b0-42ce-9fe0-b0fb74249b85</uuid>
Nov 14 14:46:06 user nova-compute[75292]:   <name>instance-0000001d</name>
Nov 14 14:46:06 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:46:06 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:46:06 user nova-compute[75292]:   <metadata>
Nov 14 14:46:06 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:46:06 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:46:06 user nova-compute[75292]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-4379320</nova:name>
Nov 14 14:46:06 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:46:06</nova:creationTime>
Nov 14 14:46:06 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:46:06 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:46:06 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:46:06 user nova-compute[75292]:       <nova:owner>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:user uuid="38a8da6883ae40c4b12c8c483d598a40">tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member</nova:user>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:project uuid="60ef654d69c34328893549c7a124aebf">tempest-ServerBootFromVolumeStableRescueTest-172724502</nova:project>
Nov 14 14:46:06 user nova-compute[75292]:       </nova:owner>
Nov 14 14:46:06 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:46:06 user nova-compute[75292]:       <nova:ports>
Nov 14 14:46:06 user nova-compute[75292]:         <nova:port uuid="4adea91d-1181-4be9-8723-50283103689f">
Nov 14 14:46:06 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:46:06 user nova-compute[75292]:         </nova:port>
Nov 14 14:46:06 user nova-compute[75292]:       </nova:ports>
Nov 14 14:46:06 user nova-compute[75292]:     </nova:instance>
Nov 14 14:46:06 user nova-compute[75292]:   </metadata>
Nov 14 14:46:06 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:46:06 user nova-compute[75292]:     <system>
Nov 14 14:46:06 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:46:06 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:46:06 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:46:06 user nova-compute[75292]:       <entry name="serial">5399567a-14b0-42ce-9fe0-b0fb74249b85</entry>
Nov 14 14:46:06 user nova-compute[75292]:       <entry name="uuid">5399567a-14b0-42ce-9fe0-b0fb74249b85</entry>
Nov 14 14:46:06 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:46:06 user nova-compute[75292]:     </system>
Nov 14 14:46:06 user nova-compute[75292]:   </sysinfo>
Nov 14 14:46:06 user nova-compute[75292]:   <os>
Nov 14 14:46:06 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:46:06 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:46:06 user nova-compute[75292]:   </os>
Nov 14 14:46:06 user nova-compute[75292]:   <features>
Nov 14 14:46:06 user nova-compute[75292]:     <acpi/>
Nov 14 14:46:06 user nova-compute[75292]:     <apic/>
Nov 14 14:46:06 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:46:06 user nova-compute[75292]:   </features>
Nov 14 14:46:06 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:46:06 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:46:06 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:46:06 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:46:06 user nova-compute[75292]:   </clock>
Nov 14 14:46:06 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:46:06 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:46:06 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:46:06 user nova-compute[75292]:   </cpu>
Nov 14 14:46:06 user nova-compute[75292]:   <devices>
Nov 14 14:46:06 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:46:06 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:46:06 user nova-compute[75292]:       <source dev="/dev/sdd"/>
Nov 14 14:46:06 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:46:06 user nova-compute[75292]:       <serial>dfb18055-e5b6-45f8-9efa-a290d1c4dbf2</serial>
Nov 14 14:46:06 user nova-compute[75292]:     </disk>
Nov 14 14:46:06 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:46:06 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:46:06 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue"/>
Nov 14 14:46:06 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:46:06 user nova-compute[75292]:       <boot order="1"/>
Nov 14 14:46:06 user nova-compute[75292]:     </disk>
Nov 14 14:46:06 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:46:06 user nova-compute[75292]:       <mac address="fa:16:3e:25:f8:ab"/>
Nov 14 14:46:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:46:06 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:46:06 user nova-compute[75292]:       <target dev="tap4adea91d-11"/>
Nov 14 14:46:06 user nova-compute[75292]:     </interface>
Nov 14 14:46:06 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:46:06 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/console.log" append="off"/>
Nov 14 14:46:06 user nova-compute[75292]:     </serial>
Nov 14 14:46:06 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:46:06 user nova-compute[75292]:     <video>
Nov 14 14:46:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:46:06 user nova-compute[75292]:     </video>
Nov 14 14:46:06 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:46:06 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:46:06 user nova-compute[75292]:     </rng>
Nov 14 14:46:06 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:46:06 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:46:06 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:46:06 user nova-compute[75292]:     </memballoon>
Nov 14 14:46:06 user nova-compute[75292]:   </devices>
Nov 14 14:46:06 user nova-compute[75292]: </domain>
Nov 14 14:46:06 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:46:06 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance destroyed successfully.
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No VIF found with MAC fa:16:3e:25:f8:ab, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:07 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Took 0.39 seconds to deallocate network for instance.
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-d05ef33b-140b-468b-9769-a99b93372bfd req-8f7b5ce6-4606-4099-9cab-7014340cbdf3 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-vif-deleted-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:46:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:07 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Deleted allocations for instance c5a143c2-8994-4297-91b2-b64ffa4e77f7
Nov 14 14:46:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-725dd527-e546-4bb3-91ec-f21cada04a63 tempest-ServersNegativeTestJSON-1575597503 tempest-ServersNegativeTestJSON-1575597503-project-member] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.890s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-a6691924-6712-41cc-aa96-5ef0c9bb17db req-980ba4c1-7a69-4394-bc60-3e65ba570c38 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received event network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a6691924-6712-41cc-aa96-5ef0c9bb17db req-980ba4c1-7a69-4394-bc60-3e65ba570c38 service nova] Acquiring lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a6691924-6712-41cc-aa96-5ef0c9bb17db req-980ba4c1-7a69-4394-bc60-3e65ba570c38 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a6691924-6712-41cc-aa96-5ef0c9bb17db req-980ba4c1-7a69-4394-bc60-3e65ba570c38 service nova] Lock "c5a143c2-8994-4297-91b2-b64ffa4e77f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-a6691924-6712-41cc-aa96-5ef0c9bb17db req-980ba4c1-7a69-4394-bc60-3e65ba570c38 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] No waiting events found dispatching network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:08 user nova-compute[75292]: WARNING nova.compute.manager [req-a6691924-6712-41cc-aa96-5ef0c9bb17db req-980ba4c1-7a69-4394-bc60-3e65ba570c38 service nova] [instance: c5a143c2-8994-4297-91b2-b64ffa4e77f7] Received unexpected event network-vif-plugged-c8de9946-2e06-4bab-853a-808befc4ef9e for instance with vm_state deleted and task_state None.
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-333a4b8e-d062-4592-8c97-e5798d22da8c req-2e0236a2-3d56-4375-9811-feef457de04e service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-333a4b8e-d062-4592-8c97-e5798d22da8c req-2e0236a2-3d56-4375-9811-feef457de04e service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-333a4b8e-d062-4592-8c97-e5798d22da8c req-2e0236a2-3d56-4375-9811-feef457de04e service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-333a4b8e-d062-4592-8c97-e5798d22da8c req-2e0236a2-3d56-4375-9811-feef457de04e service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-333a4b8e-d062-4592-8c97-e5798d22da8c req-2e0236a2-3d56-4375-9811-feef457de04e service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:08 user nova-compute[75292]: WARNING nova.compute.manager [req-333a4b8e-d062-4592-8c97-e5798d22da8c req-2e0236a2-3d56-4375-9811-feef457de04e service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state active and task_state rescuing.
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:46:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance shutdown successfully.
Nov 14 14:46:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:10 user nova-compute[75292]: WARNING nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state active and task_state rescuing.
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-unplugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-unplugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:10 user nova-compute[75292]: WARNING nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-unplugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state active and task_state reboot_started.
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:10 user nova-compute[75292]: WARNING nova.compute.manager [req-81ec9a19-3f3b-4b9c-b8f5-5b9336ce651b req-5dd27e5a-b698-4a60-864b-626255f5c505 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state active and task_state reboot_started.
Nov 14 14:46:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-7c76f15e-5c7d-402a-8ce2-ca23ef813e4d tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:12 user nova-compute[75292]: WARNING nova.compute.manager [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state active and task_state reboot_started.
Nov 14 14:46:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:12 user nova-compute[75292]: WARNING nova.compute.manager [req-77677670-8f68-4fd3-a226-0dbd5f722f30 req-e50a338b-7b1b-4d01-85c0-f6defe6d407f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state active and task_state reboot_started.
Nov 14 14:46:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance running successfully.
Nov 14 14:46:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance soft rebooted successfully.
Nov 14 14:46:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:46:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ef2f4284-1a1c-4305-a500-8a30959abb98 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.744s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:13 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:46:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:46:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:46:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=25.234539031982422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a7678b53-9d02-4504-97a5-8a92be22318c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 45f14d3a-a81c-44f0-921f-0816b4e193bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:46:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:46:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:46:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:46:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:46:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:46:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:46:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:29 user nova-compute[75292]: INFO nova.compute.manager [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Terminating instance
Nov 14 14:46:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-865b6b38-801a-4f75-8c31-ec7163fe97a9 req-1ec9eaad-63d9-4fdb-ad73-382c8f928c60 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-unplugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-865b6b38-801a-4f75-8c31-ec7163fe97a9 req-1ec9eaad-63d9-4fdb-ad73-382c8f928c60 service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-865b6b38-801a-4f75-8c31-ec7163fe97a9 req-1ec9eaad-63d9-4fdb-ad73-382c8f928c60 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-865b6b38-801a-4f75-8c31-ec7163fe97a9 req-1ec9eaad-63d9-4fdb-ad73-382c8f928c60 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-865b6b38-801a-4f75-8c31-ec7163fe97a9 req-1ec9eaad-63d9-4fdb-ad73-382c8f928c60 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-unplugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-865b6b38-801a-4f75-8c31-ec7163fe97a9 req-1ec9eaad-63d9-4fdb-ad73-382c8f928c60 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-unplugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Instance destroyed successfully.
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lazy-loading 'resources' on Instance uuid 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-47796409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1382089811',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXL14FTdkQpYas1YFHEy8DREzMtyxGvJrMS8ayO8pWfev65QDIVokNGzPZgeo0WpVNlhsgFiICYn4UVmFa4qRhuK6ujEEjVfOgf6j7HcOUueH+Tk2hZKJIseF3p+94IJQ==',key_name='tempest-keypair-493871016',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ea0f958209e4f098f0636fc392ec717',ramdisk_id='',reservation_id='r-ezdq4bn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1287985576',owner_user_name='tempest-ServerActionsV293TestJSON-1287985576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:45:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d907961ca894eaeac999bab8224c2c8',uuid=50b9cfcd-94d5-4efa-9fd5-8553ffb9a052,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converting VIF {"id": "4ac54b9d-8973-4c56-be66-971e26ac903d", "address": "fa:16:3e:3b:ee:2f", "network": {"id": "e6b7d9c9-9392-4fc2-ba17-73ef2140323f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1850034241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ea0f958209e4f098f0636fc392ec717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac54b9d-89", "ovs_interfaceid": "4ac54b9d-8973-4c56-be66-971e26ac903d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_vif [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ac54b9d-89, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba4d7c77-9d29-47e2-9769-053dc4d84a51) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:30 user nova-compute[75292]: INFO os_vif [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:ee:2f,bridge_name='br-int',has_traffic_filtering=True,id=4ac54b9d-8973-4c56-be66-971e26ac903d,network=Network(e6b7d9c9-9392-4fc2-ba17-73ef2140323f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac54b9d-89')
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UonbBYgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:46:30 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07b5cd3-9a70-49f1-be7c-cc60e2f88eff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:46:30 user nova-compute[75292]: No targets found.
Nov 14 14:46:30 user nova-compute[75292]: iSNS:
Nov 14 14:46:30 user nova-compute[75292]: No targets found.
Nov 14 14:46:30 user nova-compute[75292]: STATIC:
Nov 14 14:46:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:46:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94
Nov 14 14:46:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:46:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724
Nov 14 14:46:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:46:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:30 user nova-compute[75292]: FIRMWARE:
Nov 14 14:46:30 user nova-compute[75292]: No targets found.
Nov 14 14:46:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:46:30 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:46:30 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f47d52-3575-45df-b106-97e082628108]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d26109-1f00-405d-a478-0b95202243c2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c294280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f4c6bb-1a44-4104-b89c-708d86eb979e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f616c90-2935-4da7-a2fe-20c341266f31]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f8ed0-3a22-4712-9cbd-6f1995ba2d2c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[993f9117-ee6e-4fe1-b168-4faa6da39110]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO6ca825ac-f98b4ff501e8b341', '/dev/disk/by-id/scsi-26639386234666635', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6ca825ac') {{(pid=86373) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448ca27-37cd-4f56-adfb-8dee2c06c9bd]: (4, None) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[252b604f-27c2-4e23-8688-d984a58df7f0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9f46f5-007f-411c-903b-5319d92a43da]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260]
Nov 14 14:46:30 user nova-compute[75292]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94, portal: 172.16.0.220,3260] successful.
Nov 14 14:46:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c72be6cc-e787-4536-b933-b06a88489a94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5ddcfb-6615-4bab-bf54-4a8fd1528673]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] <== disconnect_volume: return (306ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:46:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Deleting instance files /opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052_del
Nov 14 14:46:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Deletion of /opt/stack/data/nova/instances/50b9cfcd-94d5-4efa-9fd5-8553ffb9a052_del complete
Nov 14 14:46:30 user nova-compute[75292]: INFO nova.compute.manager [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 14:46:30 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:46:30 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:46:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-84d91aca-96b4-4d43-afb8-56ca9bd42270 req-d44cfed5-0630-4271-a545-388e634df980 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-84d91aca-96b4-4d43-afb8-56ca9bd42270 req-d44cfed5-0630-4271-a545-388e634df980 service nova] Acquiring lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-84d91aca-96b4-4d43-afb8-56ca9bd42270 req-d44cfed5-0630-4271-a545-388e634df980 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-84d91aca-96b4-4d43-afb8-56ca9bd42270 req-d44cfed5-0630-4271-a545-388e634df980 service nova] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-84d91aca-96b4-4d43-afb8-56ca9bd42270 req-d44cfed5-0630-4271-a545-388e634df980 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] No waiting events found dispatching network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:31 user nova-compute[75292]: WARNING nova.compute.manager [req-84d91aca-96b4-4d43-afb8-56ca9bd42270 req-d44cfed5-0630-4271-a545-388e634df980 service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received unexpected event network-vif-plugged-4ac54b9d-8973-4c56-be66-971e26ac903d for instance with vm_state active and task_state deleting.
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:32 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Took 1.29 seconds to deallocate network for instance.
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-19824804-64f7-4faf-aa27-d1b50072658b req-7bc25843-0c8d-425b-a753-b1aac0778ffd service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Received event network-vif-deleted-4ac54b9d-8973-4c56-be66-971e26ac903d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:32 user nova-compute[75292]: INFO nova.compute.manager [req-19824804-64f7-4faf-aa27-d1b50072658b req-7bc25843-0c8d-425b-a753-b1aac0778ffd service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Neutron deleted interface 4ac54b9d-8973-4c56-be66-971e26ac903d; detaching it from the instance and deleting it from the info cache
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-19824804-64f7-4faf-aa27-d1b50072658b req-7bc25843-0c8d-425b-a753-b1aac0778ffd service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-19824804-64f7-4faf-aa27-d1b50072658b req-7bc25843-0c8d-425b-a753-b1aac0778ffd service nova] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Detach interface failed, port_id=4ac54b9d-8973-4c56-be66-971e26ac903d, reason: Instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-changed-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Refreshing instance network info cache due to event network-changed-efebda64-96d8-427d-b777-b43803cb2e92. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Refreshing network info cache for port efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:46:32 user nova-compute[75292]: INFO nova.compute.manager [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] [instance: 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052] Deleting volume: c72be6cc-e787-4536-b933-b06a88489a94 {{(pid=75292) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updated VIF entry in instance network info cache for port efebda64-96d8-427d-b777-b43803cb2e92. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c7678dc-b308-407a-9487-fceaa9934e5c req-dd60c8a7-f650-4590-8345-fbcfe846ec99 service nova] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:33 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:46:33 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:46:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:33 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Deleted allocations for instance 50b9cfcd-94d5-4efa-9fd5-8553ffb9a052
Nov 14 14:46:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b327a73-2d08-4cfb-bb3d-72922eb45b0b tempest-ServerActionsV293TestJSON-1287985576 tempest-ServerActionsV293TestJSON-1287985576-project-member] Lock "50b9cfcd-94d5-4efa-9fd5-8553ffb9a052" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.822s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Stashing vm_state: active {{(pid=75292) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:46:34 user nova-compute[75292]: INFO nova.compute.claims [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Claim successful on node user
Nov 14 14:46:34 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating resource usage from migration 5773843e-c7b5-462d-9ab6-28b521e27395
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.compute.manager [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-changed-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.compute.manager [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Refreshing instance network info cache due to event network-changed-aaf2e6af-af4a-4632-95e5-73f7a28ce01e. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] Acquiring lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] Acquired lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Refreshing network info cache for port aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.407s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:34 user nova-compute[75292]: INFO nova.compute.manager [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Migrating
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updated VIF entry in instance network info cache for port aaf2e6af-af4a-4632-95e5-73f7a28ce01e. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bdaaa24d-d3bd-430b-8db1-6b57c33bca32 req-051099b3-a8f7-4bdd-a8d0-d6395e25769d service nova] Releasing lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquired lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Releasing lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Starting migrate_disk_and_power_off {{(pid=75292) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-f5954ba0-3fb1-4f15-a62b-1d93bc653eb8 req-1c2108b7-d36d-4ea8-ac06-8d39c71b6f90 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f5954ba0-3fb1-4f15-a62b-1d93bc653eb8 req-1c2108b7-d36d-4ea8-ac06-8d39c71b6f90 service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f5954ba0-3fb1-4f15-a62b-1d93bc653eb8 req-1c2108b7-d36d-4ea8-ac06-8d39c71b6f90 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f5954ba0-3fb1-4f15-a62b-1d93bc653eb8 req-1c2108b7-d36d-4ea8-ac06-8d39c71b6f90 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-f5954ba0-3fb1-4f15-a62b-1d93bc653eb8 req-1c2108b7-d36d-4ea8-ac06-8d39c71b6f90 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:35 user nova-compute[75292]: WARNING nova.compute.manager [req-f5954ba0-3fb1-4f15-a62b-1d93bc653eb8 req-1c2108b7-d36d-4ea8-ac06-8d39c71b6f90 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state resize_migrating.
Nov 14 14:46:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance destroyed successfully.
Nov 14 14:46:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1090877024',display_name='tempest-ServerActionsTestOtherA-server-1090877024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1090877024',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-khi3cfpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=45f14d3a-a81c-44f0-921f-0816b4e193bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaf2e6af-af, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89586c83-7ed1-4d63-b9e7-dcbc66b43f21) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:46:36 user nova-compute[75292]: INFO os_vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af')
Nov 14 14:46:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:46:36 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d0b37-a9dd-4859-8875-03889d75b99c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:46:36 user nova-compute[75292]: No targets found.
Nov 14 14:46:36 user nova-compute[75292]: iSNS:
Nov 14 14:46:36 user nova-compute[75292]: No targets found.
Nov 14 14:46:36 user nova-compute[75292]: STATIC:
Nov 14 14:46:36 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:46:36 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:36 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:36 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:46:36 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:36 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:36 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724
Nov 14 14:46:36 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:36 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:36 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:46:36 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:46:36 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:46:36 user nova-compute[75292]: FIRMWARE:
Nov 14 14:46:36 user nova-compute[75292]: No targets found.
Nov 14 14:46:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:46:36 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:46:36 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc65fa64-31a8-4de8-b99f-b0a5152cebdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f46ef2d-e3fe-4df1-9cd4-ecd3fc6af778]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:36 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:36 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:36 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:36 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:36 user nova-compute[75292]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:36 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c0f1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91'): ({'sdf'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Removing single pathed devices sdf {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a70aca5-5da6-42c5-a46b-440cd8f99866]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef9948c-c8d4-4ce9-9960-70a36fdd9a70]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flushing IO for device /dev/sdf {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58acb8b-f8c7-45c2-b13f-3ed22e77eef4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7ed490-6862-4d94-af89-5567ec871520]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26638336463633863', '/dev/disk/by-id/scsi-1SCST_BIObb7983c6-f83dcc8c6e36d3b2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bb7983c6') {{(pid=86373) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4cbc1-b5b5-43b0-9f7b-b6a90fe15cea]: (4, None) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5440c080-af2f-44b5-9951-c0037d82b2d2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[13181065-3b17-4131-8600-3835609da18c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]
Nov 14 14:46:36 user nova-compute[75292]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.
Nov 14 14:46:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[218916c6-f56a-41c9-a58c-fd73173a8d13]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== disconnect_volume: return (312ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:46:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Port aaf2e6af-af4a-4632-95e5-73f7a28ce01e binding to destination host user is already ACTIVE {{(pid=75292) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-d19351cc-2363-4824-a6c5-4d8379de7ace req-601d10e2-a8ce-4ba0-b432-c106a2211c05 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d19351cc-2363-4824-a6c5-4d8379de7ace req-601d10e2-a8ce-4ba0-b432-c106a2211c05 service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d19351cc-2363-4824-a6c5-4d8379de7ace req-601d10e2-a8ce-4ba0-b432-c106a2211c05 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d19351cc-2363-4824-a6c5-4d8379de7ace req-601d10e2-a8ce-4ba0-b432-c106a2211c05 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-d19351cc-2363-4824-a6c5-4d8379de7ace req-601d10e2-a8ce-4ba0-b432-c106a2211c05 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:37 user nova-compute[75292]: WARNING nova.compute.manager [req-d19351cc-2363-4824-a6c5-4d8379de7ace req-601d10e2-a8ce-4ba0-b432-c106a2211c05 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state resize_migrated.
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquired lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:46:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG nova.network.neutron [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Releasing lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG os_brick.utils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[127db609-b20f-473c-9d04-0db9c638680e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed74c80-ebb1-4650-975d-58b584d82854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b869c-9966-4ed5-9c9c-baf9ac29c997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c203a82-79c5-4a70-8855-6498ebd4f8a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:46:38 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:46:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbde9c1-f63e-45c7-8243-f3d2b6cdfe33]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:46:38 user nova-compute[75292]: DEBUG os_brick.utils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:46:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Starting finish_migration {{(pid=75292) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:46:42 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Creating image(s)
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Ensure instance console log exists: /opt/stack/data/nova/instances/45f14d3a-a81c-44f0-921f-0816b4e193bb/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Start _get_guest_xml network_info=[{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a1bf3e36-dcad-4c97-a3c9-92d8aeff1785', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '45f14d3a-a81c-44f0-921f-0816b4e193bb', 'attached_at': '2023-11-14T14:46:43.000000', 'detached_at': '', 'volume_id': '8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'serial': '8cdefa72-53da-4b8f-ac20-4f0b9fa36b91'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:46:42 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:46:42 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:17Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:46:42 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:46:42 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:46:42 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce60737-988d-44a9-89dd-397a7cbcafb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:46:42 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c6899d-1429-455d-9a38-492cb1de0d24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91] added
Nov 14 14:46:42 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c008df20-54c6-47e8-b40d-ffdb345d71dc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a1ad1d-30b5-4949-af19-0470b9eb2695]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjyqmeBc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjyqmeBc" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a641f673-52aa-43ff-8b32-5c74b03332cc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjyqmeBc'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b8752d-d2b0-442f-93b6-dd7dde20537e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f6121a-9d3b-4ce7-a3bb-2aa138c8a9e9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:42 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:42 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:42 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:42 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:42 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:42 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:46:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b225c1-26e6-4a33-a29e-9e5d846d3883]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]
Nov 14 14:46:43 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.
Nov 14 14:46:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd5106-bbc0-45da-b5e9-e2986eaecef5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b038fb2-d03f-4015-ab22-c616f1e6a34c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:43 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:43 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:43 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:46:43 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:46:43 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:46:43 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:46:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3200377-d843-444c-8413-5bade9564bb9]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:46:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26638336463633863', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638336463633863', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1090877024',display_name='tempest-ServerActionsTestOtherA-server-1090877024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1090877024',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-khi3cfpz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=45f14d3a-a81c-44f0-921f-0816b4e193bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:46:44 user nova-compute[75292]:   <uuid>45f14d3a-a81c-44f0-921f-0816b4e193bb</uuid>
Nov 14 14:46:44 user nova-compute[75292]:   <name>instance-0000001e</name>
Nov 14 14:46:44 user nova-compute[75292]:   <memory>2097152</memory>
Nov 14 14:46:44 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:46:44 user nova-compute[75292]:   <metadata>
Nov 14 14:46:44 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:46:44 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:46:44 user nova-compute[75292]:       <nova:name>tempest-ServerActionsTestOtherA-server-1090877024</nova:name>
Nov 14 14:46:44 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:46:42</nova:creationTime>
Nov 14 14:46:44 user nova-compute[75292]:       <nova:flavor name="m1.small">
Nov 14 14:46:44 user nova-compute[75292]:         <nova:memory>2048</nova:memory>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:disk>20</nova:disk>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:46:44 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:46:44 user nova-compute[75292]:       <nova:owner>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:user uuid="e75042706a2347ebba11d20ba65ba282">tempest-ServerActionsTestOtherA-1545988335-project-member</nova:user>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:project uuid="54b7e88c2e88460484f06a772b1f60c3">tempest-ServerActionsTestOtherA-1545988335</nova:project>
Nov 14 14:46:44 user nova-compute[75292]:       </nova:owner>
Nov 14 14:46:44 user nova-compute[75292]:       <nova:ports>
Nov 14 14:46:44 user nova-compute[75292]:         <nova:port uuid="aaf2e6af-af4a-4632-95e5-73f7a28ce01e">
Nov 14 14:46:44 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 14:46:44 user nova-compute[75292]:         </nova:port>
Nov 14 14:46:44 user nova-compute[75292]:       </nova:ports>
Nov 14 14:46:44 user nova-compute[75292]:     </nova:instance>
Nov 14 14:46:44 user nova-compute[75292]:   </metadata>
Nov 14 14:46:44 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:46:44 user nova-compute[75292]:     <system>
Nov 14 14:46:44 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:46:44 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:46:44 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:46:44 user nova-compute[75292]:       <entry name="serial">45f14d3a-a81c-44f0-921f-0816b4e193bb</entry>
Nov 14 14:46:44 user nova-compute[75292]:       <entry name="uuid">45f14d3a-a81c-44f0-921f-0816b4e193bb</entry>
Nov 14 14:46:44 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:46:44 user nova-compute[75292]:     </system>
Nov 14 14:46:44 user nova-compute[75292]:   </sysinfo>
Nov 14 14:46:44 user nova-compute[75292]:   <os>
Nov 14 14:46:44 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:46:44 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:46:44 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:46:44 user nova-compute[75292]:   </os>
Nov 14 14:46:44 user nova-compute[75292]:   <features>
Nov 14 14:46:44 user nova-compute[75292]:     <acpi/>
Nov 14 14:46:44 user nova-compute[75292]:     <apic/>
Nov 14 14:46:44 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:46:44 user nova-compute[75292]:   </features>
Nov 14 14:46:44 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:46:44 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:46:44 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:46:44 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:46:44 user nova-compute[75292]:   </clock>
Nov 14 14:46:44 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:46:44 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:46:44 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:46:44 user nova-compute[75292]:   </cpu>
Nov 14 14:46:44 user nova-compute[75292]:   <devices>
Nov 14 14:46:44 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:46:44 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:46:44 user nova-compute[75292]:       <source dev="/dev/sde"/>
Nov 14 14:46:44 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:46:44 user nova-compute[75292]:       <serial>8cdefa72-53da-4b8f-ac20-4f0b9fa36b91</serial>
Nov 14 14:46:44 user nova-compute[75292]:     </disk>
Nov 14 14:46:44 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:46:44 user nova-compute[75292]:       <mac address="fa:16:3e:7a:7e:8a"/>
Nov 14 14:46:44 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:46:44 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:46:44 user nova-compute[75292]:       <target dev="tapaaf2e6af-af"/>
Nov 14 14:46:44 user nova-compute[75292]:     </interface>
Nov 14 14:46:44 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:46:44 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/45f14d3a-a81c-44f0-921f-0816b4e193bb/console.log" append="off"/>
Nov 14 14:46:44 user nova-compute[75292]:     </serial>
Nov 14 14:46:44 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:46:44 user nova-compute[75292]:     <video>
Nov 14 14:46:44 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:46:44 user nova-compute[75292]:     </video>
Nov 14 14:46:44 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:46:44 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:46:44 user nova-compute[75292]:     </rng>
Nov 14 14:46:44 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:46:44 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:46:44 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:46:44 user nova-compute[75292]:     </memballoon>
Nov 14 14:46:44 user nova-compute[75292]:   </devices>
Nov 14 14:46:44 user nova-compute[75292]: </domain>
Nov 14 14:46:44 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1090877024',display_name='tempest-ServerActionsTestOtherA-server-1090877024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1090877024',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-khi3cfpz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=45f14d3a-a81c-44f0-921f-0816b4e193bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1227730880-network", "vif_mac": "fa:16:3e:7a:7e:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG os_vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9e82803-7677-5f55-939f-e317e0026eaa', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaf2e6af-af, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaaf2e6af-af, col_values=(('qos', UUID('3f61ffcc-ea8c-4558-b4a7-1ee413062d50')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaaf2e6af-af, col_values=(('external_ids', {'iface-id': 'aaf2e6af-af4a-4632-95e5-73f7a28ce01e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:7e:8a', 'vm-uuid': '45f14d3a-a81c-44f0-921f-0816b4e193bb'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:44 user nova-compute[75292]: INFO os_vif [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af')
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] No VIF found with MAC fa:16:3e:7a:7e:8a, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:46:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-80c315db-ed77-4c49-9e2e-0b6666e925e6 req-fb849693-dde0-43c3-b629-c00b540c1faa service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-80c315db-ed77-4c49-9e2e-0b6666e925e6 req-fb849693-dde0-43c3-b629-c00b540c1faa service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-80c315db-ed77-4c49-9e2e-0b6666e925e6 req-fb849693-dde0-43c3-b629-c00b540c1faa service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-80c315db-ed77-4c49-9e2e-0b6666e925e6 req-fb849693-dde0-43c3-b629-c00b540c1faa service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-80c315db-ed77-4c49-9e2e-0b6666e925e6 req-fb849693-dde0-43c3-b629-c00b540c1faa service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:45 user nova-compute[75292]: WARNING nova.compute.manager [req-80c315db-ed77-4c49-9e2e-0b6666e925e6 req-fb849693-dde0-43c3-b629-c00b540c1faa service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state resize_finish.
Nov 14 14:46:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:46:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance running successfully.
Nov 14 14:46:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Failed to set time: agent not configured {{(pid=75292) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 14:46:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-08f8cf56-c0a2-426b-bd73-ab0bb42df8fd tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] finish_migration finished successfully. {{(pid=75292) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 14:46:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-32981956-3f89-4062-8079-e8c081d84b2b req-4c35a26a-41cd-4715-bc07-da0fe5425685 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:46:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-32981956-3f89-4062-8079-e8c081d84b2b req-4c35a26a-41cd-4715-bc07-da0fe5425685 service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:46:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-32981956-3f89-4062-8079-e8c081d84b2b req-4c35a26a-41cd-4715-bc07-da0fe5425685 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:46:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-32981956-3f89-4062-8079-e8c081d84b2b req-4c35a26a-41cd-4715-bc07-da0fe5425685 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:46:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-32981956-3f89-4062-8079-e8c081d84b2b req-4c35a26a-41cd-4715-bc07-da0fe5425685 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:46:47 user nova-compute[75292]: WARNING nova.compute.manager [req-32981956-3f89-4062-8079-e8c081d84b2b req-4c35a26a-41cd-4715-bc07-da0fe5425685 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state resized and task_state None.
Nov 14 14:46:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:46:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:09 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:47:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [{"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-e5865b32-ff16-4409-9130-4ac985de81ca" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:47:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:14 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:47:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:47:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7793MB free_disk=25.230113983154297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Applying migration context for instance 45f14d3a-a81c-44f0-921f-0816b4e193bb as it has an incoming, in-progress migration 5773843e-c7b5-462d-9ab6-28b521e27395. Migration status is finished {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 14:47:18 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating resource usage from migration 5773843e-c7b5-462d-9ab6-28b521e27395
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a7678b53-9d02-4504-97a5-8a92be22318c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Migration 5773843e-c7b5-462d-9ab6-28b521e27395 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 45f14d3a-a81c-44f0-921f-0816b4e193bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:47:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:47:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing instance network info cache due to event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:22 user nova-compute[75292]: INFO nova.compute.manager [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Detaching volume 7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:47:22 user nova-compute[75292]: INFO nova.virt.block_device [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Attempting to driver detach volume 7e2780c1-307e-4ec8-bb59-29800c46daab from mountpoint /dev/vdb
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Attempting to detach device vdb from instance a7678b53-9d02-4504-97a5-8a92be22318c from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:47:22 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:47:22 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:47:22 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:47:22 user nova-compute[75292]:   <serial>7e2780c1-307e-4ec8-bb59-29800c46daab</serial>
Nov 14 14:47:22 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:47:22 user nova-compute[75292]: </disk>
Nov 14 14:47:22 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:47:22 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully detached device vdb from instance a7678b53-9d02-4504-97a5-8a92be22318c from the persistent domain config.
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7678b53-9d02-4504-97a5-8a92be22318c from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:47:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:47:22 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:47:22 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:47:22 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:47:22 user nova-compute[75292]:   <serial>7e2780c1-307e-4ec8-bb59-29800c46daab</serial>
Nov 14 14:47:22 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:47:22 user nova-compute[75292]: </disk>
Nov 14 14:47:22 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:47:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:47:23 user nova-compute[75292]: DEBUG nova.network.neutron [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updated VIF entry in instance network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:47:23 user nova-compute[75292]: DEBUG nova.network.neutron [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ffd1b1f2-c0f6-4ca3-8927-b796264a45a3 req-48d4d96d-b9cb-4243-ac91-948da68a729d service nova] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing instance network info cache due to event network-changed-b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] Acquiring lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] Acquired lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Refreshing network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updated VIF entry in instance network info cache for port b5bee998-bef9-45ef-9249-7c33330c9960. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [{"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4b995479-32c2-4e0f-9f03-b198b462bc8f req-ee379c9b-10ed-4dd8-89ee-9253ec0bd72b service nova] Releasing lock "refresh_cache-a7678b53-9d02-4504-97a5-8a92be22318c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:47:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:47:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:47:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:47:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:40 user nova-compute[75292]: INFO nova.compute.manager [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Unshelving
Nov 14 14:47:40 user nova-compute[75292]: INFO nova.virt.block_device [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Booting with volume 06d30c2d-a92f-44b6-ab5f-66d14fb9919d at /dev/vda
Nov 14 14:47:40 user nova-compute[75292]: DEBUG os_brick.utils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d206878-cbc2-4321-9bd5-2696a2f94827]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e6440-3fb7-465b-a55b-6def21b75142]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e29ee3-317a-463d-800d-6ac9f6eea5f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0953d6d6-1381-45ed-88a9-7e71503c124b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:47:41 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:47:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[59600ec4-1093-46c2-bf60-3a3aaf5a950c]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG os_brick.utils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:47:41 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating existing volume attachment record: a6ed8013-1c07-43c1-9328-e4ee1c4a27b6 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:47:43 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a7678b53-9d02-4504-97a5-8a92be22318c is timed out.
Nov 14 14:47:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully detached device vdb from instance a7678b53-9d02-4504-97a5-8a92be22318c from the live domain config.
Nov 14 14:47:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmwYMrqP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:47:43 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c719bd-a012-4c6b-aa5a-55fa1bb3bf35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:47:43 user nova-compute[75292]: No targets found.
Nov 14 14:47:43 user nova-compute[75292]: iSNS:
Nov 14 14:47:43 user nova-compute[75292]: No targets found.
Nov 14 14:47:43 user nova-compute[75292]: STATIC:
Nov 14 14:47:43 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:47:43 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:47:43 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:47:43 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:47:43 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:47:43 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:47:43 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724
Nov 14 14:47:43 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:47:43 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:47:43 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab
Nov 14 14:47:43 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:47:43 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:47:43 user nova-compute[75292]: FIRMWARE:
Nov 14 14:47:43 user nova-compute[75292]: No targets found.
Nov 14 14:47:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:47:43 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:47:43 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64a917-ca3d-494a-b78e-8bc0b3829c9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b4ffc3-e0d0-46a1-833a-afe1a36fa0c8]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:47:43 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:47:43 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:47:43 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:47:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab (non-flash)
Nov 14 14:47:43 user nova-compute[75292]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:47:43 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:47:43 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:47:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b546e8c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd35fa-00ca-427c-aebd-cac15602b8c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[566289c0-a5e7-4175-9e88-b819550efe15]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d16e00-c502-4a03-bace-2f557f746595]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1293a5-841f-45ad-bc37-114204978afa]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f658d7-aa9e-4ba1-b052-8be0d8ab52f3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81af786a-2bce-49d2-9ebe-47b545935e81]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260]
Nov 14 14:47:43 user nova-compute[75292]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab, portal: 172.16.0.220,3260] successful.
Nov 14 14:47:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e2780c1-307e-4ec8-bb59-29800c46daab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b84a8-7936-4fe0-9628-8f336a757ed0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] <== disconnect_volume: return (313ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:47:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:47:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:44 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'flavor' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4e030a64-310f-4b90-bac9-e0a9cce3a8d5 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.821s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:46 user nova-compute[75292]: DEBUG nova.objects.instance [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'pci_requests' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:46 user nova-compute[75292]: DEBUG nova.objects.instance [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'numa_topology' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:47:46 user nova-compute[75292]: INFO nova.compute.claims [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Claim successful on node user
Nov 14 14:47:47 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:47:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:47:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:47 user nova-compute[75292]: INFO nova.network.neutron [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing instance network info cache due to event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:47:48 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Creating image(s)
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Ensure instance console log exists: /opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Start _get_guest_xml network_info=[{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a6ed8013-1c07-43c1-9328-e4ee1c4a27b6', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c9e6047-c647-4120-b74a-f62925f5849b', 'attached_at': '', 'detached_at': '', 'volume_id': '06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'serial': '06d30c2d-a92f-44b6-ab5f-66d14fb9919d'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:47:48 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:47:48 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.objects.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Object Instance<7c9e6047-c647-4120-b74a-f62925f5849b> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:47:48 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:47:48 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:47:48 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3b58e-3394-4067-85ba-16bfb5e34e98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:47:48 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b08cb0-7084-406d-840e-60d61458741e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d] added
Nov 14 14:47:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7547c6-3d46-4471-8013-7e664218814b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d57ba3e-06e4-4c50-8be2-0b1fabff705d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TArhLNRa {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TArhLNRa" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6db1bc-fa1a-416b-9d42-59412792ba16]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TArhLNRa'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d826e2-0462-499b-9e34-a4532dd8febe]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3680f0-6344-48e1-997e-813ba500a03a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a164cf7-032b-4307-9957-a6ffa49cb128]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]
Nov 14 14:47:48 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.
Nov 14 14:47:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47c083a-b59d-43bf-b394-690dc03ffb92]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updated VIF entry in instance network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[597c1e3b-030f-4e21-8708-d0028c1a22e6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:47:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:47:48 user nova-compute[75292]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:47:48 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ff4e5db-504b-4076-838a-d2262e5e4ced req-3bcb9022-d8f9-46b1-9bea-f9727822f821 service nova] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[23198539-b93c-417b-8648-f2fc32d0006b]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:47:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23135643361616566', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135643361616566', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-868401689',display_name='tempest-TestShelveInstance-server-868401689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-868401689',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-528629411',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e25e4a841b86434196bfdab20c1d3d98',ramdisk_id='',reservation_id='r-59hu8x2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-395501576',owner_user_name='tempest-TestShelveInstance-395501576-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:47:41Z,user_data=None,user_id='2f4a3c09bab1412dbb88bcbe9d90b120',uuid=7c9e6047-c647-4120-b74a-f62925f5849b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converting VIF {"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.objects.instance [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.objects.base [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Object Instance<7c9e6047-c647-4120-b74a-f62925f5849b> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:47:50 user nova-compute[75292]:   <uuid>7c9e6047-c647-4120-b74a-f62925f5849b</uuid>
Nov 14 14:47:50 user nova-compute[75292]:   <name>instance-0000001b</name>
Nov 14 14:47:50 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:47:50 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:47:50 user nova-compute[75292]:   <metadata>
Nov 14 14:47:50 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:47:50 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:47:50 user nova-compute[75292]:       <nova:name>tempest-TestShelveInstance-server-868401689</nova:name>
Nov 14 14:47:50 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:47:48</nova:creationTime>
Nov 14 14:47:50 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:47:50 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:47:50 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:47:50 user nova-compute[75292]:       <nova:owner>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:user uuid="2f4a3c09bab1412dbb88bcbe9d90b120">tempest-TestShelveInstance-395501576-project-member</nova:user>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:project uuid="e25e4a841b86434196bfdab20c1d3d98">tempest-TestShelveInstance-395501576</nova:project>
Nov 14 14:47:50 user nova-compute[75292]:       </nova:owner>
Nov 14 14:47:50 user nova-compute[75292]:       <nova:ports>
Nov 14 14:47:50 user nova-compute[75292]:         <nova:port uuid="2d2bb8e3-d3c7-4b48-81a8-471d7c811276">
Nov 14 14:47:50 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 14:47:50 user nova-compute[75292]:         </nova:port>
Nov 14 14:47:50 user nova-compute[75292]:       </nova:ports>
Nov 14 14:47:50 user nova-compute[75292]:     </nova:instance>
Nov 14 14:47:50 user nova-compute[75292]:   </metadata>
Nov 14 14:47:50 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:47:50 user nova-compute[75292]:     <system>
Nov 14 14:47:50 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:47:50 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:47:50 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:47:50 user nova-compute[75292]:       <entry name="serial">7c9e6047-c647-4120-b74a-f62925f5849b</entry>
Nov 14 14:47:50 user nova-compute[75292]:       <entry name="uuid">7c9e6047-c647-4120-b74a-f62925f5849b</entry>
Nov 14 14:47:50 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:47:50 user nova-compute[75292]:     </system>
Nov 14 14:47:50 user nova-compute[75292]:   </sysinfo>
Nov 14 14:47:50 user nova-compute[75292]:   <os>
Nov 14 14:47:50 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:47:50 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:47:50 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:47:50 user nova-compute[75292]:   </os>
Nov 14 14:47:50 user nova-compute[75292]:   <features>
Nov 14 14:47:50 user nova-compute[75292]:     <acpi/>
Nov 14 14:47:50 user nova-compute[75292]:     <apic/>
Nov 14 14:47:50 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:47:50 user nova-compute[75292]:   </features>
Nov 14 14:47:50 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:47:50 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:47:50 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:47:50 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:47:50 user nova-compute[75292]:   </clock>
Nov 14 14:47:50 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:47:50 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:47:50 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:47:50 user nova-compute[75292]:   </cpu>
Nov 14 14:47:50 user nova-compute[75292]:   <devices>
Nov 14 14:47:50 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:47:50 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:47:50 user nova-compute[75292]:       <source dev="/dev/sdc"/>
Nov 14 14:47:50 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:47:50 user nova-compute[75292]:       <serial>06d30c2d-a92f-44b6-ab5f-66d14fb9919d</serial>
Nov 14 14:47:50 user nova-compute[75292]:     </disk>
Nov 14 14:47:50 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:47:50 user nova-compute[75292]:       <mac address="fa:16:3e:e6:71:94"/>
Nov 14 14:47:50 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:47:50 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:47:50 user nova-compute[75292]:       <target dev="tap2d2bb8e3-d3"/>
Nov 14 14:47:50 user nova-compute[75292]:     </interface>
Nov 14 14:47:50 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:47:50 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b/console.log" append="off"/>
Nov 14 14:47:50 user nova-compute[75292]:     </serial>
Nov 14 14:47:50 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:47:50 user nova-compute[75292]:     <video>
Nov 14 14:47:50 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:47:50 user nova-compute[75292]:     </video>
Nov 14 14:47:50 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:47:50 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:47:50 user nova-compute[75292]:     </rng>
Nov 14 14:47:50 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:47:50 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:47:50 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:47:50 user nova-compute[75292]:     </memballoon>
Nov 14 14:47:50 user nova-compute[75292]:   </devices>
Nov 14 14:47:50 user nova-compute[75292]: </domain>
Nov 14 14:47:50 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-868401689',display_name='tempest-TestShelveInstance-server-868401689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-868401689',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-528629411',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e25e4a841b86434196bfdab20c1d3d98',ramdisk_id='',reservation_id='r-59hu8x2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-395501576',owner_user_name='tempest-TestShelveInstance-395501576-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:47:41Z,user_data=None,user_id='2f4a3c09bab1412dbb88bcbe9d90b120',uuid=7c9e6047-c647-4120-b74a-f62925f5849b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converting VIF {"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG os_vif [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd963cfe-7ce3-526a-8f79-da016626114d', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d2bb8e3-d3, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d2bb8e3-d3, col_values=(('qos', UUID('4b77a193-e520-4ee9-9cbb-f33a17bde084')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d2bb8e3-d3, col_values=(('external_ids', {'iface-id': '2d2bb8e3-d3c7-4b48-81a8-471d7c811276', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:71:94', 'vm-uuid': '7c9e6047-c647-4120-b74a-f62925f5849b'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:50 user nova-compute[75292]: INFO os_vif [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3')
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:47:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] No VIF found with MAC fa:16:3e:e6:71:94, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-5ab8324a-aff6-4682-b390-692aa955c414 req-721d69a1-b4ec-4773-b5cc-b50fad68490f service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5ab8324a-aff6-4682-b390-692aa955c414 req-721d69a1-b4ec-4773-b5cc-b50fad68490f service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5ab8324a-aff6-4682-b390-692aa955c414 req-721d69a1-b4ec-4773-b5cc-b50fad68490f service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5ab8324a-aff6-4682-b390-692aa955c414 req-721d69a1-b4ec-4773-b5cc-b50fad68490f service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-5ab8324a-aff6-4682-b390-692aa955c414 req-721d69a1-b4ec-4773-b5cc-b50fad68490f service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:47:51 user nova-compute[75292]: WARNING nova.compute.manager [req-5ab8324a-aff6-4682-b390-692aa955c414 req-721d69a1-b4ec-4773-b5cc-b50fad68490f service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 14:47:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:47:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance spawned successfully.
Nov 14 14:47:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-82f9fa1a-522f-4551-af4c-64dc56e43730 tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.817s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-8d1e4b75-3a8a-4217-8a01-8111c32bd0be req-5a299d07-9e65-44dc-81e9-59d2859926a7 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8d1e4b75-3a8a-4217-8a01-8111c32bd0be req-5a299d07-9e65-44dc-81e9-59d2859926a7 service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8d1e4b75-3a8a-4217-8a01-8111c32bd0be req-5a299d07-9e65-44dc-81e9-59d2859926a7 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8d1e4b75-3a8a-4217-8a01-8111c32bd0be req-5a299d07-9e65-44dc-81e9-59d2859926a7 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-8d1e4b75-3a8a-4217-8a01-8111c32bd0be req-5a299d07-9e65-44dc-81e9-59d2859926a7 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:47:53 user nova-compute[75292]: WARNING nova.compute.manager [req-8d1e4b75-3a8a-4217-8a01-8111c32bd0be req-5a299d07-9e65-44dc-81e9-59d2859926a7 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state active and task_state None.
Nov 14 14:47:54 user nova-compute[75292]: INFO nova.compute.manager [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Unrescuing
Nov 14 14:47:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG nova.objects.instance [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'flavor' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:55 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance destroyed successfully.
Nov 14 14:47:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:47:55 user nova-compute[75292]: WARNING nova.compute.manager [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:47:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:47:55 user nova-compute[75292]: WARNING nova.compute.manager [req-acffe361-decb-4bf9-adf9-94339479fa7e req-43c48d01-ab29-4646-be31-7dfbf8cf8d77 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:47:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing instance network info cache due to event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG nova.network.neutron [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updated VIF entry in instance network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0dcf1e32-b0bc-4d9e-8b82-bf7bb7f24c12 req-11d3e2aa-0c1d-4fb3-acfe-bf6a437e241f service nova] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:47:57 user nova-compute[75292]: WARNING nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:47:57 user nova-compute[75292]: WARNING nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing instance network info cache due to event network-changed-ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Acquiring lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Acquired lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:47:57 user nova-compute[75292]: DEBUG nova.network.neutron [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Refreshing network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:47:58 user nova-compute[75292]: INFO nova.compute.manager [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Detaching volume 9d7f7727-a728-4bca-8e09-6d3c66d1c724
Nov 14 14:47:58 user nova-compute[75292]: INFO nova.virt.block_device [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Attempting to driver detach volume 9d7f7727-a728-4bca-8e09-6d3c66d1c724 from mountpoint /dev/vdb
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Attempting to detach device vdb from instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:47:58 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:47:58 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:47:58 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:47:58 user nova-compute[75292]:   <serial>9d7f7727-a728-4bca-8e09-6d3c66d1c724</serial>
Nov 14 14:47:58 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:47:58 user nova-compute[75292]: </disk>
Nov 14 14:47:58 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:47:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully detached device vdb from instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 from the persistent domain config.
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:47:58 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:47:58 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 14:47:58 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:47:58 user nova-compute[75292]:   <serial>9d7f7727-a728-4bca-8e09-6d3c66d1c724</serial>
Nov 14 14:47:58 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:47:58 user nova-compute[75292]: </disk>
Nov 14 14:47:58 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.network.neutron [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updated VIF entry in instance network info cache for port ed98695a-a37b-4505-a91b-b531ea582d51. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.network.neutron [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [{"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-89abe0da-cbd6-434a-b38e-aa50bc8ad3b4 req-a8dc6a54-eed5-4531-a563-3221b4efd386 service nova] Releasing lock "refresh_cache-807597ab-5dd2-4c69-b47d-5b958cc9b0f3" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:47:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:47:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dd391a01-d9e4-4e5e-8a94-650a95724dab tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:47:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:48:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:48:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:48:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:48:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:48:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:48:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:48:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [{"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:48:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-fcc51f4f-7b46-4475-9cbf-53421eb0803f" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:48:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:13 user nova-compute[75292]: INFO nova.compute.manager [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Terminating instance
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-ddef0df1-e55d-41d2-837b-3d52cba61fdb req-c772c39e-67e6-4a5e-a875-c24d8889c910 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ddef0df1-e55d-41d2-837b-3d52cba61fdb req-c772c39e-67e6-4a5e-a875-c24d8889c910 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ddef0df1-e55d-41d2-837b-3d52cba61fdb req-c772c39e-67e6-4a5e-a875-c24d8889c910 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ddef0df1-e55d-41d2-837b-3d52cba61fdb req-c772c39e-67e6-4a5e-a875-c24d8889c910 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-ddef0df1-e55d-41d2-837b-3d52cba61fdb req-c772c39e-67e6-4a5e-a875-c24d8889c910 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-ddef0df1-e55d-41d2-837b-3d52cba61fdb req-c772c39e-67e6-4a5e-a875-c24d8889c910 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-unplugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Instance destroyed successfully.
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'resources' on Instance uuid a7678b53-9d02-4504-97a5-8a92be22318c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-114219581',display_name='tempest-ServerRescueNegativeTestJSON-server-114219581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-114219581',id=25,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtjnRl1Ks4Lpj+FP0MXNTlSFtMOyGZjsfkyZzWmXWa4qP8BIQlnb97O1Nz2V70smYhF6KnmlAD+18T86hqfoM6IUejgcYHG0amcmcYJ2L9mekZvZGh25+reH/cSjEyXDQ==',key_name='tempest-keypair-1120055896',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:43:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-tmfjgu0p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9970be0d6d0a4c7193237192da054e8c',uuid=a7678b53-9d02-4504-97a5-8a92be22318c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "b5bee998-bef9-45ef-9249-7c33330c9960", "address": "fa:16:3e:ff:7b:57", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5bee998-be", "ovs_interfaceid": "b5bee998-bef9-45ef-9249-7c33330c9960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG os_vif [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5bee998-be, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b388724c-2191-4805-9a9f-afbd742da5f5) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:13 user nova-compute[75292]: INFO os_vif [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:7b:57,bridge_name='br-int',has_traffic_filtering=True,id=b5bee998-bef9-45ef-9249-7c33330c9960,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5bee998-be')
Nov 14 14:48:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Deleting instance files /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c_del
Nov 14 14:48:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Deletion of /opt/stack/data/nova/instances/a7678b53-9d02-4504-97a5-8a92be22318c_del complete
Nov 14 14:48:14 user nova-compute[75292]: INFO nova.compute.manager [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 14:48:14 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:48:14 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Took 0.78 seconds to deallocate network for instance.
Nov 14 14:48:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-24ffaea7-0fb1-47e3-8a05-e13331c4bd3f req-c3b5334f-9213-4b85-a5ac-a1e459d2d7c9 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-deleted-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.446s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:48:15 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Deleted allocations for instance a7678b53-9d02-4504-97a5-8a92be22318c
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-69013919-0218-4af8-b9bd-4c26c7542d6a tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "a7678b53-9d02-4504-97a5-8a92be22318c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f25e870-3e14-4b77-94ad-f38322cdf153 req-9529d357-23ca-4c25-ad3b-f8ebeed89671 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f25e870-3e14-4b77-94ad-f38322cdf153 req-9529d357-23ca-4c25-ad3b-f8ebeed89671 service nova] Acquiring lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f25e870-3e14-4b77-94ad-f38322cdf153 req-9529d357-23ca-4c25-ad3b-f8ebeed89671 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1f25e870-3e14-4b77-94ad-f38322cdf153 req-9529d357-23ca-4c25-ad3b-f8ebeed89671 service nova] Lock "a7678b53-9d02-4504-97a5-8a92be22318c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-1f25e870-3e14-4b77-94ad-f38322cdf153 req-9529d357-23ca-4c25-ad3b-f8ebeed89671 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] No waiting events found dispatching network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:48:15 user nova-compute[75292]: WARNING nova.compute.manager [req-1f25e870-3e14-4b77-94ad-f38322cdf153 req-9529d357-23ca-4c25-ad3b-f8ebeed89671 service nova] [instance: a7678b53-9d02-4504-97a5-8a92be22318c] Received unexpected event network-vif-plugged-b5bee998-bef9-45ef-9249-7c33330c9960 for instance with vm_state deleted and task_state None.
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:48:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8016MB free_disk=25.245357513427734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Applying migration context for instance 45f14d3a-a81c-44f0-921f-0816b4e193bb as it has an incoming, in-progress migration 5773843e-c7b5-462d-9ab6-28b521e27395. Migration status is finished {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 14:48:18 user nova-compute[75292]: INFO nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating resource usage from migration 5773843e-c7b5-462d-9ab6-28b521e27395
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance fcc51f4f-7b46-4475-9cbf-53421eb0803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Migration 5773843e-c7b5-462d-9ab6-28b521e27395 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 45f14d3a-a81c-44f0-921f-0816b4e193bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7c9e6047-c647-4120-b74a-f62925f5849b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:18 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 is timed out.
Nov 14 14:48:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully detached device vdb from instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 from the live domain config.
Nov 14 14:48:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HJQhLBbf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:48:18 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca274d4-7922-474a-8719-7dbfa43d76e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:48:18 user nova-compute[75292]: No targets found.
Nov 14 14:48:18 user nova-compute[75292]: iSNS:
Nov 14 14:48:18 user nova-compute[75292]: No targets found.
Nov 14 14:48:18 user nova-compute[75292]: STATIC:
Nov 14 14:48:18 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:48:18 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:48:18 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:48:18 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:48:18 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:48:18 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:48:18 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724
Nov 14 14:48:18 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:48:18 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:48:18 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d
Nov 14 14:48:18 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:48:18 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:48:18 user nova-compute[75292]: FIRMWARE:
Nov 14 14:48:18 user nova-compute[75292]: No targets found.
Nov 14 14:48:18 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:48:18 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:48:18 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df92f143-16c4-40a7-8245-37dfef79d26d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b506c1-9aaf-4798-b5a0-c1c3803ee2aa]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:48:18 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:48:18 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:48:18 user nova-compute[75292]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:48:18 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:48:18 user nova-compute[75292]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 (non-flash)
Nov 14 14:48:18 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:48:18 user nova-compute[75292]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:48:18 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b540fe0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d25bfda-171c-4007-a00d-9cc5e3ddddaf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b41274-c746-4a25-ba3b-c7d664048684]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8fb423-ff5e-4fa6-ad3f-0413be85cc33]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac2c15-893a-4059-9ffe-14733771b6fb]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2a61f1-c06d-48d7-b639-ce1acd6a402a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9073c3-48e6-4759-a77a-13e46137879e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260]
Nov 14 14:48:19 user nova-compute[75292]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724, portal: 172.16.0.220,3260] successful.
Nov 14 14:48:19 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d7f7727-a728-4bca-8e09-6d3c66d1c724 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a325e2-1ad6-417a-8c1d-7b9cb8346726]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] <== disconnect_volume: return (317ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:48:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG nova.objects.instance [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'flavor' on Instance uuid 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-46a055ea-96e0-42ec-be9c-464c6f159009 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.962s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Going to confirm migration 2 {{(pid=75292) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquired lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'info_cache' on Instance uuid 45f14d3a-a81c-44f0-921f-0816b4e193bb {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:48:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [{"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Releasing lock "refresh_cache-45f14d3a-a81c-44f0-921f-0816b4e193bb" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'migration_context' on Instance uuid 45f14d3a-a81c-44f0-921f-0816b4e193bb {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG nova.objects.base [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Object Instance<45f14d3a-a81c-44f0-921f-0816b4e193bb> lazy-loaded attributes: info_cache,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:48:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.384s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:25 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Deleted allocation for migration 5773843e-c7b5-462d-9ab6-28b521e27395
Nov 14 14:48:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6dc9dc19-2170-4643-ae4d-d02e2a04a6b5 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.643s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:50 user nova-compute[75292]: INFO nova.compute.manager [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Terminating instance
Nov 14 14:48:50 user nova-compute[75292]: DEBUG nova.compute.manager [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-e2f1b75e-0d21-4842-aad4-a04c5f084729 req-6ba0b8bd-759c-4982-91b8-12de92defaea service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-unplugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e2f1b75e-0d21-4842-aad4-a04c5f084729 req-6ba0b8bd-759c-4982-91b8-12de92defaea service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e2f1b75e-0d21-4842-aad4-a04c5f084729 req-6ba0b8bd-759c-4982-91b8-12de92defaea service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e2f1b75e-0d21-4842-aad4-a04c5f084729 req-6ba0b8bd-759c-4982-91b8-12de92defaea service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-e2f1b75e-0d21-4842-aad4-a04c5f084729 req-6ba0b8bd-759c-4982-91b8-12de92defaea service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-unplugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-e2f1b75e-0d21-4842-aad4-a04c5f084729 req-6ba0b8bd-759c-4982-91b8-12de92defaea service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-unplugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:48:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Instance destroyed successfully.
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lazy-loading 'resources' on Instance uuid 807597ab-5dd2-4c69-b47d-5b958cc9b0f3 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-499020818',display_name='tempest-TestMinimumBasicScenario-server-499020818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-499020818',id=28,image_ref='5284ed19-d530-44f8-a89d-9cd3f0f47cd0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5IakQQHCYVIXrTZ6TitU85XYIXoxLT4mJm3JWUiK5f82G/0dug+BNO4GeT2Sy2HkQxzswwR4DvDZoiUcRwLz3y2u9DZ/gMujvfxybXrcJ9NODErn0jtilyVDeGEaAzdA==',key_name='tempest-TestMinimumBasicScenario-62354778',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4452a2c5ea7451997f344226737bf38',ramdisk_id='',reservation_id='r-1udj01sa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5284ed19-d530-44f8-a89d-9cd3f0f47cd0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-364849145',owner_user_name='tempest-TestMinimumBasicScenario-364849145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:46:13Z,user_data=None,user_id='8f20ed29c2964cf5bc164dc614dcb97c',uuid=807597ab-5dd2-4c69-b47d-5b958cc9b0f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converting VIF {"id": "ed98695a-a37b-4505-a91b-b531ea582d51", "address": "fa:16:3e:92:18:94", "network": {"id": "7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-714328870-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4452a2c5ea7451997f344226737bf38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped98695a-a3", "ovs_interfaceid": "ed98695a-a37b-4505-a91b-b531ea582d51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG os_vif [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped98695a-a3, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f986e31d-c20d-4ad5-b42c-ed070ef8542b) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:51 user nova-compute[75292]: INFO os_vif [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:18:94,bridge_name='br-int',has_traffic_filtering=True,id=ed98695a-a37b-4505-a91b-b531ea582d51,network=Network(7e6a8d61-1b91-4e78-b759-b4d3a6fbdd60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped98695a-a3')
Nov 14 14:48:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Deleting instance files /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3_del
Nov 14 14:48:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Deletion of /opt/stack/data/nova/instances/807597ab-5dd2-4c69-b47d-5b958cc9b0f3_del complete
Nov 14 14:48:51 user nova-compute[75292]: INFO nova.compute.manager [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 14:48:51 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:48:51 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:48:52 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:48:52 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Took 0.76 seconds to deallocate network for instance.
Nov 14 14:48:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-bbdb6078-77a7-4461-b8d3-a907e420ca61 req-8da4b49c-6892-4118-b68e-28b5a19cc3bc service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-deleted-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:48:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:48:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:48:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:52 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Deleted allocations for instance 807597ab-5dd2-4c69-b47d-5b958cc9b0f3
Nov 14 14:48:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-096b40fb-347a-4573-b492-621112e319b4 tempest-TestMinimumBasicScenario-364849145 tempest-TestMinimumBasicScenario-364849145-project-member] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3636654-67c3-4493-9b00-48d76c6fee59 req-ee1e3984-3e0c-4754-99dd-be9c15693c72 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:48:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3636654-67c3-4493-9b00-48d76c6fee59 req-ee1e3984-3e0c-4754-99dd-be9c15693c72 service nova] Acquiring lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:48:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3636654-67c3-4493-9b00-48d76c6fee59 req-ee1e3984-3e0c-4754-99dd-be9c15693c72 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:48:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3636654-67c3-4493-9b00-48d76c6fee59 req-ee1e3984-3e0c-4754-99dd-be9c15693c72 service nova] Lock "807597ab-5dd2-4c69-b47d-5b958cc9b0f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:48:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3636654-67c3-4493-9b00-48d76c6fee59 req-ee1e3984-3e0c-4754-99dd-be9c15693c72 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] No waiting events found dispatching network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:48:53 user nova-compute[75292]: WARNING nova.compute.manager [req-a3636654-67c3-4493-9b00-48d76c6fee59 req-ee1e3984-3e0c-4754-99dd-be9c15693c72 service nova] [instance: 807597ab-5dd2-4c69-b47d-5b958cc9b0f3] Received unexpected event network-vif-plugged-ed98695a-a37b-4505-a91b-b531ea582d51 for instance with vm_state deleted and task_state None.
Nov 14 14:48:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:48:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:49:03 user nova-compute[75292]: INFO nova.compute.claims [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Claim successful on node user
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:49:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:49:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Creating image(s)
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "/opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "/opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "/opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:03 user nova-compute[75292]: DEBUG nova.policy [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d2a969f8d924908b94319b09da16949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f986a9cc69146d58b322282d38eb722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk 1073741824" returned: 0 in 0.096s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Cannot resize image /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Ensure instance console log exists: /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Successfully created port: 7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:49:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Successfully updated port: 7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquired lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-changed-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Refreshing instance network info cache due to event network-changed-7f53ada9-9e21-4c8a-945d-723bc6fb89a5. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] Acquiring lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:49:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.neutron [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updating instance_info_cache with network_info: [{"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Releasing lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Instance network_info: |[{"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] Acquired lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Refreshing network info cache for port 7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Start _get_guest_xml network_info=[{"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:49:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:49:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1496227372',display_name='tempest-VolumesSnapshotTestJSON-instance-1496227372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1496227372',id=31,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF15IiGbh0Mtk7QE95ovCiZVMsKTQpa1WVCJhbU1oIGgoY8DW6P48Ys8dk3FnZaBuxFLn9ygKY+W8/u9U8Ucmdn3EjaVdUNlvzqTYcfTdbmgocifSWLRhvEjXAqXxIs3Q==',key_name='tempest-keypair-1919413428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f986a9cc69146d58b322282d38eb722',ramdisk_id='',reservation_id='r-s4zn2qy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-641028471',owner_user_name='tempest-VolumesSnapshotTestJSON-641028471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2a969f8d924908b94319b09da16949',uuid=7406189e-7077-4c43-bea1-5d3c5a5781aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converting VIF {"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'pci_devices' on Instance uuid 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:49:06 user nova-compute[75292]:   <uuid>7406189e-7077-4c43-bea1-5d3c5a5781aa</uuid>
Nov 14 14:49:06 user nova-compute[75292]:   <name>instance-0000001f</name>
Nov 14 14:49:06 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:49:06 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:49:06 user nova-compute[75292]:   <metadata>
Nov 14 14:49:06 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:49:06 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:49:06 user nova-compute[75292]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1496227372</nova:name>
Nov 14 14:49:06 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:49:06</nova:creationTime>
Nov 14 14:49:06 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:49:06 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:49:06 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:49:06 user nova-compute[75292]:       <nova:owner>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:user uuid="1d2a969f8d924908b94319b09da16949">tempest-VolumesSnapshotTestJSON-641028471-project-member</nova:user>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:project uuid="0f986a9cc69146d58b322282d38eb722">tempest-VolumesSnapshotTestJSON-641028471</nova:project>
Nov 14 14:49:06 user nova-compute[75292]:       </nova:owner>
Nov 14 14:49:06 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:49:06 user nova-compute[75292]:       <nova:ports>
Nov 14 14:49:06 user nova-compute[75292]:         <nova:port uuid="7f53ada9-9e21-4c8a-945d-723bc6fb89a5">
Nov 14 14:49:06 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 14:49:06 user nova-compute[75292]:         </nova:port>
Nov 14 14:49:06 user nova-compute[75292]:       </nova:ports>
Nov 14 14:49:06 user nova-compute[75292]:     </nova:instance>
Nov 14 14:49:06 user nova-compute[75292]:   </metadata>
Nov 14 14:49:06 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:49:06 user nova-compute[75292]:     <system>
Nov 14 14:49:06 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:49:06 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:49:06 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:49:06 user nova-compute[75292]:       <entry name="serial">7406189e-7077-4c43-bea1-5d3c5a5781aa</entry>
Nov 14 14:49:06 user nova-compute[75292]:       <entry name="uuid">7406189e-7077-4c43-bea1-5d3c5a5781aa</entry>
Nov 14 14:49:06 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:49:06 user nova-compute[75292]:     </system>
Nov 14 14:49:06 user nova-compute[75292]:   </sysinfo>
Nov 14 14:49:06 user nova-compute[75292]:   <os>
Nov 14 14:49:06 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:49:06 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:49:06 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:49:06 user nova-compute[75292]:   </os>
Nov 14 14:49:06 user nova-compute[75292]:   <features>
Nov 14 14:49:06 user nova-compute[75292]:     <acpi/>
Nov 14 14:49:06 user nova-compute[75292]:     <apic/>
Nov 14 14:49:06 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:49:06 user nova-compute[75292]:   </features>
Nov 14 14:49:06 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:49:06 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:49:06 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:49:06 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:49:06 user nova-compute[75292]:   </clock>
Nov 14 14:49:06 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:49:06 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:49:06 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:49:06 user nova-compute[75292]:   </cpu>
Nov 14 14:49:06 user nova-compute[75292]:   <devices>
Nov 14 14:49:06 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:49:06 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:49:06 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk"/>
Nov 14 14:49:06 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:49:06 user nova-compute[75292]:     </disk>
Nov 14 14:49:06 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:49:06 user nova-compute[75292]:       <mac address="fa:16:3e:19:97:02"/>
Nov 14 14:49:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:49:06 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:49:06 user nova-compute[75292]:       <target dev="tap7f53ada9-9e"/>
Nov 14 14:49:06 user nova-compute[75292]:     </interface>
Nov 14 14:49:06 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:49:06 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/console.log" append="off"/>
Nov 14 14:49:06 user nova-compute[75292]:     </serial>
Nov 14 14:49:06 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:49:06 user nova-compute[75292]:     <video>
Nov 14 14:49:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:49:06 user nova-compute[75292]:     </video>
Nov 14 14:49:06 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:49:06 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:49:06 user nova-compute[75292]:     </rng>
Nov 14 14:49:06 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:49:06 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:49:06 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:49:06 user nova-compute[75292]:     </memballoon>
Nov 14 14:49:06 user nova-compute[75292]:   </devices>
Nov 14 14:49:06 user nova-compute[75292]: </domain>
Nov 14 14:49:06 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1496227372',display_name='tempest-VolumesSnapshotTestJSON-instance-1496227372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1496227372',id=31,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF15IiGbh0Mtk7QE95ovCiZVMsKTQpa1WVCJhbU1oIGgoY8DW6P48Ys8dk3FnZaBuxFLn9ygKY+W8/u9U8Ucmdn3EjaVdUNlvzqTYcfTdbmgocifSWLRhvEjXAqXxIs3Q==',key_name='tempest-keypair-1919413428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f986a9cc69146d58b322282d38eb722',ramdisk_id='',reservation_id='r-s4zn2qy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-641028471',owner_user_name='tempest-VolumesSnapshotTestJSON-641028471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:49:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2a969f8d924908b94319b09da16949',uuid=7406189e-7077-4c43-bea1-5d3c5a5781aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converting VIF {"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG os_vif [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d033bb5-b786-564c-b4a3-7a0127ed5616', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f53ada9-9e, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f53ada9-9e, col_values=(('qos', UUID('4c00b39d-2fd4-44ff-94a9-a3a6abd7ca02')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f53ada9-9e, col_values=(('external_ids', {'iface-id': '7f53ada9-9e21-4c8a-945d-723bc6fb89a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:97:02', 'vm-uuid': '7406189e-7077-4c43-bea1-5d3c5a5781aa'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:06 user nova-compute[75292]: INFO os_vif [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e')
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No VIF found with MAC fa:16:3e:19:97:02, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updated VIF entry in instance network info cache for port 7f53ada9-9e21-4c8a-945d-723bc6fb89a5. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updating instance_info_cache with network_info: [{"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49ddedb3-959a-4c99-aee1-78f22fce0ad2 req-ecad5970-8a24-4c2d-a9d2-6ac255d64b57 service nova] Releasing lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d629c70-2375-42a3-bb4e-a1c3b011fb9e req-8e226a60-c5ac-42ec-a2b8-44cc3af64d5a service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d629c70-2375-42a3-bb4e-a1c3b011fb9e req-8e226a60-c5ac-42ec-a2b8-44cc3af64d5a service nova] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d629c70-2375-42a3-bb4e-a1c3b011fb9e req-8e226a60-c5ac-42ec-a2b8-44cc3af64d5a service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1d629c70-2375-42a3-bb4e-a1c3b011fb9e req-8e226a60-c5ac-42ec-a2b8-44cc3af64d5a service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-1d629c70-2375-42a3-bb4e-a1c3b011fb9e req-8e226a60-c5ac-42ec-a2b8-44cc3af64d5a service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] No waiting events found dispatching network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:07 user nova-compute[75292]: WARNING nova.compute.manager [req-1d629c70-2375-42a3-bb4e-a1c3b011fb9e req-8e226a60-c5ac-42ec-a2b8-44cc3af64d5a service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received unexpected event network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 for instance with vm_state building and task_state spawning.
Nov 14 14:49:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.compute.manager [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Terminating instance
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Instance destroyed successfully.
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'resources' on Instance uuid fcc51f4f-7b46-4475-9cbf-53421eb0803f {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1530529335',display_name='tempest-ServerRescueNegativeTestJSON-server-1530529335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1530529335',id=3,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:35:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-fiv5ql8h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:35:08Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=fcc51f4f-7b46-4475-9cbf-53421eb0803f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "address": "fa:16:3e:4d:f2:d8", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34cfacd-c6", "ovs_interfaceid": "f34cfacd-c6a0-40a5-894b-98b4c7c5cf47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG os_vif [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34cfacd-c6, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce2488c8-6819-4406-b63c-462e4a4cb5da) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:49:09 user nova-compute[75292]: INFO os_vif [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:f2:d8,bridge_name='br-int',has_traffic_filtering=True,id=f34cfacd-c6a0-40a5-894b-98b4c7c5cf47,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34cfacd-c6')
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Deleting instance files /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f_del
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Deletion of /opt/stack/data/nova/instances/fcc51f4f-7b46-4475-9cbf-53421eb0803f_del complete
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Instance spawned successfully.
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.compute.manager [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] No waiting events found dispatching network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:09 user nova-compute[75292]: WARNING nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received unexpected event network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 for instance with vm_state building and task_state spawning.
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-unplugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-unplugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-unplugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:09 user nova-compute[75292]: WARNING nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state rescued and task_state deleting.
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:09 user nova-compute[75292]: WARNING nova.compute.manager [req-5cefbe4c-d54c-4936-b836-7ac6165aa9e0 req-ae91f1d7-c5be-41f8-af98-d18e4f87f919 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state rescued and task_state deleting.
Nov 14 14:49:09 user nova-compute[75292]: INFO nova.compute.manager [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Took 6.66 seconds to build instance.
Nov 14 14:49:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb4dfac1-aaee-4a94-a6e3-76ce7452f2e0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.767s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:10 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:10 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Took 0.68 seconds to deallocate network for instance.
Nov 14 14:49:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:10 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:49:10 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:49:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:10 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Deleted allocations for instance fcc51f4f-7b46-4475-9cbf-53421eb0803f
Nov 14 14:49:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-233a163a-6e77-496e-b642-d5341914afa2 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:11 user nova-compute[75292]: WARNING nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state deleted and task_state None.
Nov 14 14:49:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-deleted-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] Acquiring lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] Lock "fcc51f4f-7b46-4475-9cbf-53421eb0803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] No waiting events found dispatching network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:11 user nova-compute[75292]: WARNING nova.compute.manager [req-62c74e00-6f0e-4848-a1d0-1525e5a22c2d req-336d09d3-c605-4bda-8808-5bab4fe63983 service nova] [instance: fcc51f4f-7b46-4475-9cbf-53421eb0803f] Received unexpected event network-vif-plugged-f34cfacd-c6a0-40a5-894b-98b4c7c5cf47 for instance with vm_state deleted and task_state None.
Nov 14 14:49:13 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:49:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:49:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:49:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:49:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [{"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c75f05cb-4b25-4c55-81f6-4853a6ee4938" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:49:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:49:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:15 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:49:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:49:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:49:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.29705047607422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance e5865b32-ff16-4409-9130-4ac985de81ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 45f14d3a-a81c-44f0-921f-0816b4e193bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7c9e6047-c647-4120-b74a-f62925f5849b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7406189e-7077-4c43-bea1-5d3c5a5781aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 14:49:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 14:49:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 14:49:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing instance network info cache due to event network-changed-2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] Acquiring lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] Acquired lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Refreshing network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:32 user nova-compute[75292]: INFO nova.compute.manager [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Terminating instance
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5bd8636a-1470-4989-ab6b-8f837a151ce1 req-52b06bb0-7c56-4a99-b1c7-47bb39d04f0a service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-unplugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5bd8636a-1470-4989-ab6b-8f837a151ce1 req-52b06bb0-7c56-4a99-b1c7-47bb39d04f0a service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5bd8636a-1470-4989-ab6b-8f837a151ce1 req-52b06bb0-7c56-4a99-b1c7-47bb39d04f0a service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5bd8636a-1470-4989-ab6b-8f837a151ce1 req-52b06bb0-7c56-4a99-b1c7-47bb39d04f0a service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5bd8636a-1470-4989-ab6b-8f837a151ce1 req-52b06bb0-7c56-4a99-b1c7-47bb39d04f0a service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-unplugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-5bd8636a-1470-4989-ab6b-8f837a151ce1 req-52b06bb0-7c56-4a99-b1c7-47bb39d04f0a service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-unplugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updated VIF entry in instance network info cache for port 2d2bb8e3-d3c7-4b48-81a8-471d7c811276. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG nova.network.neutron [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [{"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5b864501-8c6d-4901-ba49-87fe0f3c539b req-4086f1c4-757b-4924-ada0-6c6e4539e2d1 service nova] Releasing lock "refresh_cache-7c9e6047-c647-4120-b74a-f62925f5849b" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:49:32 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid c75f05cb-4b25-4c55-81f6-4853a6ee4938 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid a8a94376-8ca1-4e3d-84b5-e597543f7ce4 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 45f14d3a-a81c-44f0-921f-0816b4e193bb {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Instance destroyed successfully.
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.objects.instance [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lazy-loading 'resources' on Instance uuid 7c9e6047-c647-4120-b74a-f62925f5849b {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-868401689',display_name='tempest-TestShelveInstance-server-868401689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-868401689',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqjTyffMIw4MlE/BwkaOu7XIGIxkb5xs4EfszFIY6DNyGFuKvjQd6pdmU4qfiIAciBA9FVqY7s+vUx2ut01uwn4K4iy3jTixAifs6BEuGHCmcoaAYINj00+tjDpox9+/A==',key_name='tempest-TestShelveInstance-528629411',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:47:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e25e4a841b86434196bfdab20c1d3d98',ramdisk_id='',reservation_id='r-59hu8x2m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-395501576',owner_user_name='tempest-TestShelveInstance-395501576-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:47:54Z,user_data=None,user_id='2f4a3c09bab1412dbb88bcbe9d90b120',uuid=7c9e6047-c647-4120-b74a-f62925f5849b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converting VIF {"id": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "address": "fa:16:3e:e6:71:94", "network": {"id": "0f7f244e-57ab-457a-ac99-1749c800f558", "bridge": "br-int", "label": "tempest-TestShelveInstance-1744461895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e25e4a841b86434196bfdab20c1d3d98", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d2bb8e3-d3", "ovs_interfaceid": "2d2bb8e3-d3c7-4b48-81a8-471d7c811276", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_vif [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d2bb8e3-d3, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b77a193-e520-4ee9-9cbb-f33a17bde084) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:33 user nova-compute[75292]: INFO os_vif [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:71:94,bridge_name='br-int',has_traffic_filtering=True,id=2d2bb8e3-d3c7-4b48-81a8-471d7c811276,network=Network(0f7f244e-57ab-457a-ac99-1749c800f558),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d2bb8e3-d3')
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TArhLNRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:49:33 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef992a2-3da7-468f-bc3b-41de910dc81e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:49:33 user nova-compute[75292]: No targets found.
Nov 14 14:49:33 user nova-compute[75292]: iSNS:
Nov 14 14:49:33 user nova-compute[75292]: No targets found.
Nov 14 14:49:33 user nova-compute[75292]: STATIC:
Nov 14 14:49:33 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:49:33 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:49:33 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:49:33 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:49:33 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:49:33 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:49:33 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d
Nov 14 14:49:33 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:49:33 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:49:33 user nova-compute[75292]: FIRMWARE:
Nov 14 14:49:33 user nova-compute[75292]: No targets found.
Nov 14 14:49:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:49:33 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:49:33 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[323a9353-95ce-4c2f-8151-9a3d81ed0a85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[98939aa5-dd90-4ac7-b80a-0aa30842f116]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:49:33 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:49:33 user nova-compute[75292]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:49:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:49:33 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:49:33 user nova-compute[75292]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d (non-flash)
Nov 14 14:49:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5463fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[32588486-4232-4603-8c72-7b229fa1b700]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0b7506-0e5e-4787-bc71-338c0489e3da]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9e752-13e9-4059-bac4-5f968ee011f5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31c024-1883-4bde-b28e-90b59e21f0c6]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c320c4-9f60-4d8d-bebc-704f5cc93188]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dedfc3-a24c-4536-87a6-1488b7bbdd6b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260]
Nov 14 14:49:33 user nova-compute[75292]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d, portal: 172.16.0.220,3260] successful.
Nov 14 14:49:33 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06d30c2d-a92f-44b6-ab5f-66d14fb9919d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[22745994-07cf-4d57-b4e6-92765333cd22]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] <== disconnect_volume: return (307ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:49:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Deleting instance files /opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b_del
Nov 14 14:49:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Deletion of /opt/stack/data/nova/instances/7c9e6047-c647-4120-b74a-f62925f5849b_del complete
Nov 14 14:49:33 user nova-compute[75292]: INFO nova.compute.manager [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 14:49:33 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:33 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Took 0.40 seconds to deallocate network for instance.
Nov 14 14:49:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-ed84f3e1-910f-4968-a988-239e69f64266 req-e96eb634-4b26-4f94-994b-43fbd8722433 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-deleted-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:34 user nova-compute[75292]: INFO nova.compute.manager [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 14:49:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Deleting volume: 06d30c2d-a92f-44b6-ab5f-66d14fb9919d {{(pid=75292) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG nova.compute.manager [req-b5864206-59b8-4076-ba63-c7bd5715e782 req-43f85ddd-deca-4173-a996-0ef13c4c9834 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5864206-59b8-4076-ba63-c7bd5715e782 req-43f85ddd-deca-4173-a996-0ef13c4c9834 service nova] Acquiring lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5864206-59b8-4076-ba63-c7bd5715e782 req-43f85ddd-deca-4173-a996-0ef13c4c9834 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b5864206-59b8-4076-ba63-c7bd5715e782 req-43f85ddd-deca-4173-a996-0ef13c4c9834 service nova] Lock "7c9e6047-c647-4120-b74a-f62925f5849b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG nova.compute.manager [req-b5864206-59b8-4076-ba63-c7bd5715e782 req-43f85ddd-deca-4173-a996-0ef13c4c9834 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] No waiting events found dispatching network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:34 user nova-compute[75292]: WARNING nova.compute.manager [req-b5864206-59b8-4076-ba63-c7bd5715e782 req-43f85ddd-deca-4173-a996-0ef13c4c9834 service nova] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] Received unexpected event network-vif-plugged-2d2bb8e3-d3c7-4b48-81a8-471d7c811276 for instance with vm_state active and task_state deleting.
Nov 14 14:49:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:49:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:35 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Deleted allocations for instance 7c9e6047-c647-4120-b74a-f62925f5849b
Nov 14 14:49:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dd35b3a0-541e-4516-a72e-f0ca46539c8c tempest-TestShelveInstance-395501576 tempest-TestShelveInstance-395501576-project-member] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.812s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.061s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:35 user nova-compute[75292]: INFO nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 7c9e6047-c647-4120-b74a-f62925f5849b] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 14 14:49:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7c9e6047-c647-4120-b74a-f62925f5849b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:49:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:45 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:49:45 user nova-compute[75292]: INFO nova.compute.claims [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Claim successful on node user
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:49:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:49:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Creating image(s)
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG nova.policy [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38a8da6883ae40c4b12c8c483d598a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ef654d69c34328893549c7a124aebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk 1073741824" returned: 0 in 0.056s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Cannot resize image /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Ensure instance console log exists: /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Successfully created port: 1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:49:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Successfully updated port: 1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-changed-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Refreshing instance network info cache due to event network-changed-1d0296bc-073f-4a13-b323-274fee9ee9be. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] Acquiring lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Updating instance_info_cache with network_info: [{"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Instance network_info: |[{"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] Acquired lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Refreshing network info cache for port 1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Start _get_guest_xml network_info=[{"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:49:48 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:49:48 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2099610150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2099610150',id=32,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-4zh2wakt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:49:46Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=c4450564-68bb-4ee9-ab0b-9100ce602a46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'pci_devices' on Instance uuid c4450564-68bb-4ee9-ab0b-9100ce602a46 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:49:48 user nova-compute[75292]:   <uuid>c4450564-68bb-4ee9-ab0b-9100ce602a46</uuid>
Nov 14 14:49:48 user nova-compute[75292]:   <name>instance-00000020</name>
Nov 14 14:49:48 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:49:48 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:49:48 user nova-compute[75292]:   <metadata>
Nov 14 14:49:48 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:49:48 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:49:48 user nova-compute[75292]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2099610150</nova:name>
Nov 14 14:49:48 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:49:48</nova:creationTime>
Nov 14 14:49:48 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:49:48 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:49:48 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:49:48 user nova-compute[75292]:       <nova:owner>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:user uuid="38a8da6883ae40c4b12c8c483d598a40">tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member</nova:user>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:project uuid="60ef654d69c34328893549c7a124aebf">tempest-ServerBootFromVolumeStableRescueTest-172724502</nova:project>
Nov 14 14:49:48 user nova-compute[75292]:       </nova:owner>
Nov 14 14:49:48 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:49:48 user nova-compute[75292]:       <nova:ports>
Nov 14 14:49:48 user nova-compute[75292]:         <nova:port uuid="1d0296bc-073f-4a13-b323-274fee9ee9be">
Nov 14 14:49:48 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 14:49:48 user nova-compute[75292]:         </nova:port>
Nov 14 14:49:48 user nova-compute[75292]:       </nova:ports>
Nov 14 14:49:48 user nova-compute[75292]:     </nova:instance>
Nov 14 14:49:48 user nova-compute[75292]:   </metadata>
Nov 14 14:49:48 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:49:48 user nova-compute[75292]:     <system>
Nov 14 14:49:48 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:49:48 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:49:48 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:49:48 user nova-compute[75292]:       <entry name="serial">c4450564-68bb-4ee9-ab0b-9100ce602a46</entry>
Nov 14 14:49:48 user nova-compute[75292]:       <entry name="uuid">c4450564-68bb-4ee9-ab0b-9100ce602a46</entry>
Nov 14 14:49:48 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:49:48 user nova-compute[75292]:     </system>
Nov 14 14:49:48 user nova-compute[75292]:   </sysinfo>
Nov 14 14:49:48 user nova-compute[75292]:   <os>
Nov 14 14:49:48 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:49:48 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:49:48 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:49:48 user nova-compute[75292]:   </os>
Nov 14 14:49:48 user nova-compute[75292]:   <features>
Nov 14 14:49:48 user nova-compute[75292]:     <acpi/>
Nov 14 14:49:48 user nova-compute[75292]:     <apic/>
Nov 14 14:49:48 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:49:48 user nova-compute[75292]:   </features>
Nov 14 14:49:48 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:49:48 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:49:48 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:49:48 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:49:48 user nova-compute[75292]:   </clock>
Nov 14 14:49:48 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:49:48 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:49:48 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:49:48 user nova-compute[75292]:   </cpu>
Nov 14 14:49:48 user nova-compute[75292]:   <devices>
Nov 14 14:49:48 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:49:48 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:49:48 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk"/>
Nov 14 14:49:48 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:49:48 user nova-compute[75292]:     </disk>
Nov 14 14:49:48 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:49:48 user nova-compute[75292]:       <mac address="fa:16:3e:84:41:da"/>
Nov 14 14:49:48 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:49:48 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:49:48 user nova-compute[75292]:       <target dev="tap1d0296bc-07"/>
Nov 14 14:49:48 user nova-compute[75292]:     </interface>
Nov 14 14:49:48 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:49:48 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/console.log" append="off"/>
Nov 14 14:49:48 user nova-compute[75292]:     </serial>
Nov 14 14:49:48 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:49:48 user nova-compute[75292]:     <video>
Nov 14 14:49:48 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:49:48 user nova-compute[75292]:     </video>
Nov 14 14:49:48 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:49:48 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:49:48 user nova-compute[75292]:     </rng>
Nov 14 14:49:48 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:49:48 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:49:48 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:49:48 user nova-compute[75292]:     </memballoon>
Nov 14 14:49:48 user nova-compute[75292]:   </devices>
Nov 14 14:49:48 user nova-compute[75292]: </domain>
Nov 14 14:49:48 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2099610150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2099610150',id=32,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-4zh2wakt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:49:46Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=c4450564-68bb-4ee9-ab0b-9100ce602a46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG os_vif [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83a9aed3-a5cd-5e9b-ab12-845a6931ca8c', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d0296bc-07, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d0296bc-07, col_values=(('qos', UUID('4a4b250b-1323-49df-ae63-4f343cd78e39')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d0296bc-07, col_values=(('external_ids', {'iface-id': '1d0296bc-073f-4a13-b323-274fee9ee9be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:41:da', 'vm-uuid': 'c4450564-68bb-4ee9-ab0b-9100ce602a46'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:48 user nova-compute[75292]: INFO os_vif [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07')
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No VIF found with MAC fa:16:3e:84:41:da, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Updated VIF entry in instance network info cache for port 1d0296bc-073f-4a13-b323-274fee9ee9be. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:49:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Updating instance_info_cache with network_info: [{"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:49:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-562a3e3f-77d0-4d4d-82d2-e338d09633d9 req-7e40de14-cf46-4772-946f-0103cb98d3d0 service nova] Releasing lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-0bea443d-c1e3-4a7f-b7ac-54f4b849d8dd req-580f2678-5911-4661-b59f-bd21242d40d2 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0bea443d-c1e3-4a7f-b7ac-54f4b849d8dd req-580f2678-5911-4661-b59f-bd21242d40d2 service nova] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0bea443d-c1e3-4a7f-b7ac-54f4b849d8dd req-580f2678-5911-4661-b59f-bd21242d40d2 service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0bea443d-c1e3-4a7f-b7ac-54f4b849d8dd req-580f2678-5911-4661-b59f-bd21242d40d2 service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-0bea443d-c1e3-4a7f-b7ac-54f4b849d8dd req-580f2678-5911-4661-b59f-bd21242d40d2 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] No waiting events found dispatching network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:50 user nova-compute[75292]: WARNING nova.compute.manager [req-0bea443d-c1e3-4a7f-b7ac-54f4b849d8dd req-580f2678-5911-4661-b59f-bd21242d40d2 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received unexpected event network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be for instance with vm_state building and task_state spawning.
Nov 14 14:49:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-359790bc-f00b-4488-829a-daf31fdf0777 req-2136c9db-0489-4b24-8998-844c392a1f18 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-359790bc-f00b-4488-829a-daf31fdf0777 req-2136c9db-0489-4b24-8998-844c392a1f18 service nova] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-359790bc-f00b-4488-829a-daf31fdf0777 req-2136c9db-0489-4b24-8998-844c392a1f18 service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-359790bc-f00b-4488-829a-daf31fdf0777 req-2136c9db-0489-4b24-8998-844c392a1f18 service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-359790bc-f00b-4488-829a-daf31fdf0777 req-2136c9db-0489-4b24-8998-844c392a1f18 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] No waiting events found dispatching network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:49:52 user nova-compute[75292]: WARNING nova.compute.manager [req-359790bc-f00b-4488-829a-daf31fdf0777 req-2136c9db-0489-4b24-8998-844c392a1f18 service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received unexpected event network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be for instance with vm_state building and task_state spawning.
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:49:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Instance spawned successfully.
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:49:52 user nova-compute[75292]: INFO nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 14 14:49:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:49:52 user nova-compute[75292]: INFO nova.compute.manager [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Took 6.65 seconds to build instance.
Nov 14 14:49:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a599ef88-2d2b-4bdd-b035-c974efa4009e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.750s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:49:59 user nova-compute[75292]: INFO nova.compute.manager [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Terminating instance
Nov 14 14:49:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:49:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Instance destroyed successfully.
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lazy-loading 'resources' on Instance uuid e5865b32-ff16-4409-9130-4ac985de81ca {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1903340639',display_name='tempest-ServerRescueNegativeTestJSON-server-1903340639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1903340639',id=1,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:37:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='850c4eb7326f46c59998de50b99686c0',ramdisk_id='',reservation_id='r-rbudekua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1737174677',owner_user_name='tempest-ServerRescueNegativeTestJSON-1737174677-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:39:51Z,user_data=None,user_id='9970be0d6d0a4c7193237192da054e8c',uuid=e5865b32-ff16-4409-9130-4ac985de81ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converting VIF {"id": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "address": "fa:16:3e:67:e1:18", "network": {"id": "8d818570-b254-46a4-a497-fc5bdda102c4", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-344081152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "850c4eb7326f46c59998de50b99686c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81d5c23c-27", "ovs_interfaceid": "81d5c23c-2743-4ba8-a05f-a5c91722f552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG os_vif [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81d5c23c-27, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a4dfc9b-3207-4478-8b21-527dd630662e) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:00 user nova-compute[75292]: INFO os_vif [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:e1:18,bridge_name='br-int',has_traffic_filtering=True,id=81d5c23c-2743-4ba8-a05f-a5c91722f552,network=Network(8d818570-b254-46a4-a497-fc5bdda102c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81d5c23c-27')
Nov 14 14:50:00 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Deleting instance files /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca_del
Nov 14 14:50:00 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Deletion of /opt/stack/data/nova/instances/e5865b32-ff16-4409-9130-4ac985de81ca_del complete
Nov 14 14:50:00 user nova-compute[75292]: INFO nova.compute.manager [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 14:50:00 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1cb5054-4c3f-4a29-bf87-b1d9af226dc4 req-c034c068-9b36-4a31-a1ec-ca97f0bccad7 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1cb5054-4c3f-4a29-bf87-b1d9af226dc4 req-c034c068-9b36-4a31-a1ec-ca97f0bccad7 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1cb5054-4c3f-4a29-bf87-b1d9af226dc4 req-c034c068-9b36-4a31-a1ec-ca97f0bccad7 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a1cb5054-4c3f-4a29-bf87-b1d9af226dc4 req-c034c068-9b36-4a31-a1ec-ca97f0bccad7 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1cb5054-4c3f-4a29-bf87-b1d9af226dc4 req-c034c068-9b36-4a31-a1ec-ca97f0bccad7 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:50:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-a1cb5054-4c3f-4a29-bf87-b1d9af226dc4 req-c034c068-9b36-4a31-a1ec-ca97f0bccad7 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-unplugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:50:01 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Took 0.75 seconds to deallocate network for instance.
Nov 14 14:50:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-508f47a6-f9f1-4366-80cf-fe23b02e91fe req-794146b5-1707-409e-a72e-9b95353909d6 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-deleted-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:01 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Deleted allocations for instance e5865b32-ff16-4409-9130-4ac985de81ca
Nov 14 14:50:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8344a87-286b-4744-bd15-838975da8126 tempest-ServerRescueNegativeTestJSON-1737174677 tempest-ServerRescueNegativeTestJSON-1737174677-project-member] Lock "e5865b32-ff16-4409-9130-4ac985de81ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-3bbbd69b-989d-4284-95c6-66954c92d8e7 req-e59227bd-f7a9-4109-a558-dbf929ee8433 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bbbd69b-989d-4284-95c6-66954c92d8e7 req-e59227bd-f7a9-4109-a558-dbf929ee8433 service nova] Acquiring lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bbbd69b-989d-4284-95c6-66954c92d8e7 req-e59227bd-f7a9-4109-a558-dbf929ee8433 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3bbbd69b-989d-4284-95c6-66954c92d8e7 req-e59227bd-f7a9-4109-a558-dbf929ee8433 service nova] Lock "e5865b32-ff16-4409-9130-4ac985de81ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:02 user nova-compute[75292]: DEBUG nova.compute.manager [req-3bbbd69b-989d-4284-95c6-66954c92d8e7 req-e59227bd-f7a9-4109-a558-dbf929ee8433 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] No waiting events found dispatching network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:50:02 user nova-compute[75292]: WARNING nova.compute.manager [req-3bbbd69b-989d-4284-95c6-66954c92d8e7 req-e59227bd-f7a9-4109-a558-dbf929ee8433 service nova] [instance: e5865b32-ff16-4409-9130-4ac985de81ca] Received unexpected event network-vif-plugged-81d5c23c-2743-4ba8-a05f-a5c91722f552 for instance with vm_state deleted and task_state None.
Nov 14 14:50:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:06 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:50:07 user nova-compute[75292]: INFO nova.compute.claims [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Claim successful on node user
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:50:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:50:07 user nova-compute[75292]: DEBUG nova.policy [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12846e84377c40998d795e5f0b09252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebd367820b4847b1f8b7c402a22ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:50:07 user nova-compute[75292]: INFO nova.virt.block_device [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Booting with volume snapshot 7c8c3c20-9807-4bfd-b68d-8d0bfcbe28e3 at /dev/vda
Nov 14 14:50:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Successfully created port: 5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:50:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Successfully updated port: 5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:50:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "refresh_cache-f867ca7d-4cc6-472c-8ee6-a279a35f34ed" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:50:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquired lock "refresh_cache-f867ca7d-4cc6-472c-8ee6-a279a35f34ed" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:50:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:50:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-changed-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Refreshing instance network info cache due to event network-changed-5c6b3b03-d3f2-4090-aceb-9867741c9911. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] Acquiring lock "refresh_cache-f867ca7d-4cc6-472c-8ee6-a279a35f34ed" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Updating instance_info_cache with network_info: [{"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Releasing lock "refresh_cache-f867ca7d-4cc6-472c-8ee6-a279a35f34ed" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Instance network_info: |[{"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] Acquired lock "refresh_cache-f867ca7d-4cc6-472c-8ee6-a279a35f34ed" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Refreshing network info cache for port 5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Updated VIF entry in instance network info cache for port 5c6b3b03-d3f2-4090-aceb-9867741c9911. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Updating instance_info_cache with network_info: [{"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e263ede6-168e-4829-b7a4-71db7edcdb02 req-f214f7fd-82b5-42d6-9b61-d458b771ccd4 service nova] Releasing lock "refresh_cache-f867ca7d-4cc6-472c-8ee6-a279a35f34ed" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:50:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG os_brick.utils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fbf8a8-9005-4512-909c-d95cba06154b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f51b78-1848-40f8-9bc5-7298a2d15b7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5692688-cc69-4a72-9805-3c34ba9a3694]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f4dbbf-be48-41ae-87aa-70fcc4abdd88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:50:13 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:50:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37874be-85a7-4a67-980d-09d0cf319933]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG os_brick.utils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:50:13 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Updating existing volume attachment record: 4a7fcc8b-7d0e-47a9-8099-f9412b44a327 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:50:14 user nova-compute[75292]: INFO nova.compute.manager [None req-222e393c-decd-424c-8724-2a3216f18835 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Get console output
Nov 14 14:50:14 user nova-compute[75292]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 14:50:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:50:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:50:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:50:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:50:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updating instance_info_cache with network_info: [{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:50:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:50:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:50:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:50:17 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Creating image(s)
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Ensure instance console log exists: /opt/stack/data/nova/instances/f867ca7d-4cc6-472c-8ee6-a279a35f34ed/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Start _get_guest_xml network_info=[{"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4a7fcc8b-7d0e-47a9-8099-f9412b44a327', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOIhmzyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f867ca7d-4cc6-472c-8ee6-a279a35f34ed', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd83340c-c405-4a66-ab7e-f2a72e2dd8ad', 'serial': 'dd83340c-c405-4a66-ab7e-f2a72e2dd8ad'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:50:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:50:17 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOIhmzyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:50:17 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:50:17 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:50:17 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fabe7d-f4ba-491a-9afe-3072bf0a20c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:50:17 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d856d0d6-d6e3-4a17-8252-60eeec4a4294]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad] added
Nov 14 14:50:17 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[033281a9-eb90-44e3-8d22-77a86ad75050]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7f9a25-3b5e-4b57-b7f9-1674a0396c95]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOIhmzyG {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOIhmzyG" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e1862-e2e3-49b6-a911-bf45ae6980f4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FOIhmzyG'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de1c33c-7416-4764-a300-bda176ce2d41]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2bf6b0-4620-40c6-85d7-0befbe79af0a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:17 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:17 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:17 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:17 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:50:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd48098d-b1de-484b-b590-1bb2511182da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260]
Nov 14 14:50:18 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260] successful.
Nov 14 14:50:18 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3752d9d-2dae-4edc-9985-3616672052d4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e1402c-a91a-4d3e-8ce7-813cbbf981e9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:18 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:18 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:50:18 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:18 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:18 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:50:18 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f24aa55-bc10-4b52-a957-0c35b6836fe9]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOIhmzyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23131343033376664', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131343033376664', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-966436112',display_name='tempest-TestVolumeBootPattern-server-966436112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-966436112',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-o0yngcau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:50:08Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=f867ca7d-4cc6-472c-8ee6-a279a35f34ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'pci_devices' on Instance uuid f867ca7d-4cc6-472c-8ee6-a279a35f34ed {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:50:19 user nova-compute[75292]:   <uuid>f867ca7d-4cc6-472c-8ee6-a279a35f34ed</uuid>
Nov 14 14:50:19 user nova-compute[75292]:   <name>instance-00000021</name>
Nov 14 14:50:19 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:50:19 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:50:19 user nova-compute[75292]:   <metadata>
Nov 14 14:50:19 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:50:19 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:50:19 user nova-compute[75292]:       <nova:name>tempest-TestVolumeBootPattern-server-966436112</nova:name>
Nov 14 14:50:19 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:50:17</nova:creationTime>
Nov 14 14:50:19 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:50:19 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:50:19 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:50:19 user nova-compute[75292]:       <nova:owner>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:user uuid="12846e84377c40998d795e5f0b09252f">tempest-TestVolumeBootPattern-53606599-project-member</nova:user>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:project uuid="6cebd367820b4847b1f8b7c402a22ffc">tempest-TestVolumeBootPattern-53606599</nova:project>
Nov 14 14:50:19 user nova-compute[75292]:       </nova:owner>
Nov 14 14:50:19 user nova-compute[75292]:       <nova:ports>
Nov 14 14:50:19 user nova-compute[75292]:         <nova:port uuid="5c6b3b03-d3f2-4090-aceb-9867741c9911">
Nov 14 14:50:19 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 14:50:19 user nova-compute[75292]:         </nova:port>
Nov 14 14:50:19 user nova-compute[75292]:       </nova:ports>
Nov 14 14:50:19 user nova-compute[75292]:     </nova:instance>
Nov 14 14:50:19 user nova-compute[75292]:   </metadata>
Nov 14 14:50:19 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:50:19 user nova-compute[75292]:     <system>
Nov 14 14:50:19 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:50:19 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:50:19 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:50:19 user nova-compute[75292]:       <entry name="serial">f867ca7d-4cc6-472c-8ee6-a279a35f34ed</entry>
Nov 14 14:50:19 user nova-compute[75292]:       <entry name="uuid">f867ca7d-4cc6-472c-8ee6-a279a35f34ed</entry>
Nov 14 14:50:19 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:50:19 user nova-compute[75292]:     </system>
Nov 14 14:50:19 user nova-compute[75292]:   </sysinfo>
Nov 14 14:50:19 user nova-compute[75292]:   <os>
Nov 14 14:50:19 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:50:19 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:50:19 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:50:19 user nova-compute[75292]:   </os>
Nov 14 14:50:19 user nova-compute[75292]:   <features>
Nov 14 14:50:19 user nova-compute[75292]:     <acpi/>
Nov 14 14:50:19 user nova-compute[75292]:     <apic/>
Nov 14 14:50:19 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:50:19 user nova-compute[75292]:   </features>
Nov 14 14:50:19 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:50:19 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:50:19 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:50:19 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:50:19 user nova-compute[75292]:   </clock>
Nov 14 14:50:19 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:50:19 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:50:19 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:50:19 user nova-compute[75292]:   </cpu>
Nov 14 14:50:19 user nova-compute[75292]:   <devices>
Nov 14 14:50:19 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:50:19 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:50:19 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:50:19 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:50:19 user nova-compute[75292]:       <serial>dd83340c-c405-4a66-ab7e-f2a72e2dd8ad</serial>
Nov 14 14:50:19 user nova-compute[75292]:     </disk>
Nov 14 14:50:19 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:50:19 user nova-compute[75292]:       <mac address="fa:16:3e:6b:df:4b"/>
Nov 14 14:50:19 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:50:19 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:50:19 user nova-compute[75292]:       <target dev="tap5c6b3b03-d3"/>
Nov 14 14:50:19 user nova-compute[75292]:     </interface>
Nov 14 14:50:19 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:50:19 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/f867ca7d-4cc6-472c-8ee6-a279a35f34ed/console.log" append="off"/>
Nov 14 14:50:19 user nova-compute[75292]:     </serial>
Nov 14 14:50:19 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:50:19 user nova-compute[75292]:     <video>
Nov 14 14:50:19 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:50:19 user nova-compute[75292]:     </video>
Nov 14 14:50:19 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:50:19 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:50:19 user nova-compute[75292]:     </rng>
Nov 14 14:50:19 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:50:19 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:50:19 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:50:19 user nova-compute[75292]:     </memballoon>
Nov 14 14:50:19 user nova-compute[75292]:   </devices>
Nov 14 14:50:19 user nova-compute[75292]: </domain>
Nov 14 14:50:19 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-966436112',display_name='tempest-TestVolumeBootPattern-server-966436112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-966436112',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-o0yngcau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:50:08Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=f867ca7d-4cc6-472c-8ee6-a279a35f34ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG os_vif [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96a2fbe6-0120-576a-b682-be87f40693b4', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c6b3b03-d3, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c6b3b03-d3, col_values=(('qos', UUID('d0450c4b-7730-4009-bd79-e02dfc0956b7')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c6b3b03-d3, col_values=(('external_ids', {'iface-id': '5c6b3b03-d3f2-4090-aceb-9867741c9911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:df:4b', 'vm-uuid': 'f867ca7d-4cc6-472c-8ee6-a279a35f34ed'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:19 user nova-compute[75292]: INFO os_vif [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3')
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No VIF found with MAC fa:16:3e:6b:df:4b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:50:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:50:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8237MB free_disk=25.297618865966797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 45f14d3a-a81c-44f0-921f-0816b4e193bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7406189e-7077-4c43-bea1-5d3c5a5781aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f867ca7d-4cc6-472c-8ee6-a279a35f34ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-2520a40d-0637-4fb1-b9c8-d302c3f0496a req-f1477351-dd90-408c-a286-dc8cb3e60e1b service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2520a40d-0637-4fb1-b9c8-d302c3f0496a req-f1477351-dd90-408c-a286-dc8cb3e60e1b service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2520a40d-0637-4fb1-b9c8-d302c3f0496a req-f1477351-dd90-408c-a286-dc8cb3e60e1b service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2520a40d-0637-4fb1-b9c8-d302c3f0496a req-f1477351-dd90-408c-a286-dc8cb3e60e1b service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-2520a40d-0637-4fb1-b9c8-d302c3f0496a req-f1477351-dd90-408c-a286-dc8cb3e60e1b service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:50:20 user nova-compute[75292]: WARNING nova.compute.manager [req-2520a40d-0637-4fb1-b9c8-d302c3f0496a req-f1477351-dd90-408c-a286-dc8cb3e60e1b service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received unexpected event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with vm_state building and task_state spawning.
Nov 14 14:50:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:50:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:50:22 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Instance spawned successfully.
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-7e729cde-f707-4265-85be-6161236109a6 req-4b106ac4-d797-4806-9fc3-af743558572c service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7e729cde-f707-4265-85be-6161236109a6 req-4b106ac4-d797-4806-9fc3-af743558572c service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7e729cde-f707-4265-85be-6161236109a6 req-4b106ac4-d797-4806-9fc3-af743558572c service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7e729cde-f707-4265-85be-6161236109a6 req-4b106ac4-d797-4806-9fc3-af743558572c service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-7e729cde-f707-4265-85be-6161236109a6 req-4b106ac4-d797-4806-9fc3-af743558572c service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:50:22 user nova-compute[75292]: WARNING nova.compute.manager [req-7e729cde-f707-4265-85be-6161236109a6 req-4b106ac4-d797-4806-9fc3-af743558572c service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received unexpected event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with vm_state building and task_state spawning.
Nov 14 14:50:22 user nova-compute[75292]: INFO nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 14 14:50:22 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:50:23 user nova-compute[75292]: INFO nova.compute.manager [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Took 16.10 seconds to build instance.
Nov 14 14:50:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b7edb01b-bdb1-4861-a1ed-e57620c20c27 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.185s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:50:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-changed-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Refreshing instance network info cache due to event network-changed-7f53ada9-9e21-4c8a-945d-723bc6fb89a5. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] Acquiring lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] Acquired lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG nova.network.neutron [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Refreshing network info cache for port 7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'flavor' on Instance uuid 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:50:54 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Ignoring supplied device name: /dev/vdb
Nov 14 14:50:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:50:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updated VIF entry in instance network info cache for port 7f53ada9-9e21-4c8a-945d-723bc6fb89a5. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updating instance_info_cache with network_info: [{"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:50:55 user nova-compute[75292]: INFO nova.compute.manager [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Attaching volume 4dbf570e-2345-469d-9da5-f5958f704152 to /dev/vdb
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fd396a6b-78e7-401b-aa4c-c35798ac686c req-dde6412d-01f1-4712-8b17-39a3b9f68a1c service nova] Releasing lock "refresh_cache-7406189e-7077-4c43-bea1-5d3c5a5781aa" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG os_brick.utils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a82777-9e7c-415e-816d-147d23d08fe5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d805cc-aa93-4139-b37f-657d75a2d04b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b290a-9cc7-4958-81a1-47c1d6db3b6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f31a33-4e92-42c2-a51e-87c8c39c992b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:50:55 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:50:55 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5256a549-5a31-493b-8e56-1f4e7817b963]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG os_brick.utils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:50:55 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updating existing volume attachment record: 2ce532b8-f71c-4aad-926b-41f3109bf12c {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwTomraI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:50:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:50:59 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:50:59 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20a7290-b81b-4f35-a562-3d4c06f9ba0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:50:59 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3623fb40-8cc8-4255-9ff4-2bc69549eafb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152] added
Nov 14 14:50:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92ee15b-fd1c-4220-bf5d-be3bea4a8551]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[883319b1-7f00-481d-83df-92995568958b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwTomraI {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwTomraI" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe2705-c349-4ea9-aec5-3f505c085f91]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwTomraI'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42ca94-13b2-44da-9517-df8a06f098f4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[798753a1-bcef-40d4-81fb-eac22239964b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:50:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:50:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8233afb5-0ef8-433f-9cc4-fb8add83afc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260]
Nov 14 14:50:59 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260] successful.
Nov 14 14:50:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[681fb77d-148c-45da-9967-39a7399568b4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d4367-328e-43e6-bc98-bf4eff9aa1a5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:50:59 user nova-compute[75292]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)
Nov 14 14:50:59 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3855cf47-df28-45ac-a32d-9c1258c26ed9]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:50:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwTomraI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23364353432366134', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364353432366134', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'flavor' on Instance uuid 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:51:00 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:51:00 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:51:00 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:51:00 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:51:00 user nova-compute[75292]:   <serial>4dbf570e-2345-469d-9da5-f5958f704152</serial>
Nov 14 14:51:00 user nova-compute[75292]: </disk>
Nov 14 14:51:00 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:51:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:51:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:51:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No VIF found with MAC fa:16:3e:19:97:02, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:51:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0df66667-8e9e-4f31-a5db-494728fce5ab tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.464s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:51:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:03 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:51:03 user nova-compute[75292]: INFO nova.compute.claims [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Claim successful on node user
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:51:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.policy [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3a7efbb426e4b558031f14a751e102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1d477a1d84afeb07533cddfe992d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:51:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Creating image(s)
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "/opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.204s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk 1073741824" returned: 0 in 0.078s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Successfully created port: 8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Cannot resize image /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Ensure instance console log exists: /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Successfully updated port: 8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquired lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-changed-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Refreshing instance network info cache due to event network-changed-8821ecbc-47fb-4114-b050-0969d765f1ef. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] Acquiring lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updating instance_info_cache with network_info: [{"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Releasing lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Instance network_info: |[{"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] Acquired lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Refreshing network info cache for port 8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:51:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Start _get_guest_xml network_info=[{"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:51:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:51:06 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-924007152',display_name='tempest-AttachVolumeNegativeTest-server-924007152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-924007152',id=34,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDur19HmfjZFrqdAW+QoR14mAyeRD0Emk86TGofP3fhyKLKNY7Od+GRCSD8n6ZZcR36WdAPi25gixk87A2PxlUyarNs4mtFBBIfoorOiEi6A5p+4wsiAjQq+zcdquJp6Vw==',key_name='tempest-keypair-1565465919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-sh68xysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=52818903-146d-429a-893e-3f6da6a8a17c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'pci_devices' on Instance uuid 52818903-146d-429a-893e-3f6da6a8a17c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:51:06 user nova-compute[75292]:   <uuid>52818903-146d-429a-893e-3f6da6a8a17c</uuid>
Nov 14 14:51:06 user nova-compute[75292]:   <name>instance-00000022</name>
Nov 14 14:51:06 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:51:06 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:51:06 user nova-compute[75292]:   <metadata>
Nov 14 14:51:06 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:51:06 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:51:06 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeNegativeTest-server-924007152</nova:name>
Nov 14 14:51:06 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:51:06</nova:creationTime>
Nov 14 14:51:06 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:51:06 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:51:06 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:51:06 user nova-compute[75292]:       <nova:owner>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:user uuid="d3a7efbb426e4b558031f14a751e102b">tempest-AttachVolumeNegativeTest-547312228-project-member</nova:user>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:project uuid="8ae1d477a1d84afeb07533cddfe992d1">tempest-AttachVolumeNegativeTest-547312228</nova:project>
Nov 14 14:51:06 user nova-compute[75292]:       </nova:owner>
Nov 14 14:51:06 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:51:06 user nova-compute[75292]:       <nova:ports>
Nov 14 14:51:06 user nova-compute[75292]:         <nova:port uuid="8821ecbc-47fb-4114-b050-0969d765f1ef">
Nov 14 14:51:06 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 14:51:06 user nova-compute[75292]:         </nova:port>
Nov 14 14:51:06 user nova-compute[75292]:       </nova:ports>
Nov 14 14:51:06 user nova-compute[75292]:     </nova:instance>
Nov 14 14:51:06 user nova-compute[75292]:   </metadata>
Nov 14 14:51:06 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:51:06 user nova-compute[75292]:     <system>
Nov 14 14:51:06 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:51:06 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:51:06 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:51:06 user nova-compute[75292]:       <entry name="serial">52818903-146d-429a-893e-3f6da6a8a17c</entry>
Nov 14 14:51:06 user nova-compute[75292]:       <entry name="uuid">52818903-146d-429a-893e-3f6da6a8a17c</entry>
Nov 14 14:51:06 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:51:06 user nova-compute[75292]:     </system>
Nov 14 14:51:06 user nova-compute[75292]:   </sysinfo>
Nov 14 14:51:06 user nova-compute[75292]:   <os>
Nov 14 14:51:06 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:51:06 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:51:06 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:51:06 user nova-compute[75292]:   </os>
Nov 14 14:51:06 user nova-compute[75292]:   <features>
Nov 14 14:51:06 user nova-compute[75292]:     <acpi/>
Nov 14 14:51:06 user nova-compute[75292]:     <apic/>
Nov 14 14:51:06 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:51:06 user nova-compute[75292]:   </features>
Nov 14 14:51:06 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:51:06 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:51:06 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:51:06 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:51:06 user nova-compute[75292]:   </clock>
Nov 14 14:51:06 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:51:06 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:51:06 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:51:06 user nova-compute[75292]:   </cpu>
Nov 14 14:51:06 user nova-compute[75292]:   <devices>
Nov 14 14:51:06 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:51:06 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:51:06 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk"/>
Nov 14 14:51:06 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:51:06 user nova-compute[75292]:     </disk>
Nov 14 14:51:06 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:51:06 user nova-compute[75292]:       <mac address="fa:16:3e:6e:30:23"/>
Nov 14 14:51:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:51:06 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:51:06 user nova-compute[75292]:       <target dev="tap8821ecbc-47"/>
Nov 14 14:51:06 user nova-compute[75292]:     </interface>
Nov 14 14:51:06 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:51:06 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/console.log" append="off"/>
Nov 14 14:51:06 user nova-compute[75292]:     </serial>
Nov 14 14:51:06 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:51:06 user nova-compute[75292]:     <video>
Nov 14 14:51:06 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:51:06 user nova-compute[75292]:     </video>
Nov 14 14:51:06 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:51:06 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:51:06 user nova-compute[75292]:     </rng>
Nov 14 14:51:06 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:51:06 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:51:06 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:51:06 user nova-compute[75292]:     </memballoon>
Nov 14 14:51:06 user nova-compute[75292]:   </devices>
Nov 14 14:51:06 user nova-compute[75292]: </domain>
Nov 14 14:51:06 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-924007152',display_name='tempest-AttachVolumeNegativeTest-server-924007152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-924007152',id=34,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDur19HmfjZFrqdAW+QoR14mAyeRD0Emk86TGofP3fhyKLKNY7Od+GRCSD8n6ZZcR36WdAPi25gixk87A2PxlUyarNs4mtFBBIfoorOiEi6A5p+4wsiAjQq+zcdquJp6Vw==',key_name='tempest-keypair-1565465919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-sh68xysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=52818903-146d-429a-893e-3f6da6a8a17c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG os_vif [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f945568f-42dc-5806-89db-e3994e389981', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8821ecbc-47, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8821ecbc-47, col_values=(('qos', UUID('c23fe69b-39c2-422f-aaf6-b8a98efcbe87')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8821ecbc-47, col_values=(('external_ids', {'iface-id': '8821ecbc-47fb-4114-b050-0969d765f1ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:30:23', 'vm-uuid': '52818903-146d-429a-893e-3f6da6a8a17c'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:06 user nova-compute[75292]: INFO os_vif [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47')
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:6e:30:23, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updated VIF entry in instance network info cache for port 8821ecbc-47fb-4114-b050-0969d765f1ef. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG nova.network.neutron [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updating instance_info_cache with network_info: [{"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:51:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ae127221-6b56-4a6c-83dd-4dcd04466bd2 req-a076d23e-acc4-4489-ae95-29d7376e0051 service nova] Releasing lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-82c52405-97a9-4162-8f32-9208b54ba13b req-69336f86-8098-433f-ad88-a9934f0ce1a3 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-82c52405-97a9-4162-8f32-9208b54ba13b req-69336f86-8098-433f-ad88-a9934f0ce1a3 service nova] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-82c52405-97a9-4162-8f32-9208b54ba13b req-69336f86-8098-433f-ad88-a9934f0ce1a3 service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-82c52405-97a9-4162-8f32-9208b54ba13b req-69336f86-8098-433f-ad88-a9934f0ce1a3 service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-82c52405-97a9-4162-8f32-9208b54ba13b req-69336f86-8098-433f-ad88-a9934f0ce1a3 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] No waiting events found dispatching network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:07 user nova-compute[75292]: WARNING nova.compute.manager [req-82c52405-97a9-4162-8f32-9208b54ba13b req-69336f86-8098-433f-ad88-a9934f0ce1a3 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received unexpected event network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef for instance with vm_state building and task_state spawning.
Nov 14 14:51:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:51:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Instance spawned successfully.
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-2bc6babb-c023-4367-9e8c-f7cf8beea4b4 req-059c07ab-7978-4fac-a6a6-6fb5fb8e770f service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2bc6babb-c023-4367-9e8c-f7cf8beea4b4 req-059c07ab-7978-4fac-a6a6-6fb5fb8e770f service nova] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2bc6babb-c023-4367-9e8c-f7cf8beea4b4 req-059c07ab-7978-4fac-a6a6-6fb5fb8e770f service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2bc6babb-c023-4367-9e8c-f7cf8beea4b4 req-059c07ab-7978-4fac-a6a6-6fb5fb8e770f service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-2bc6babb-c023-4367-9e8c-f7cf8beea4b4 req-059c07ab-7978-4fac-a6a6-6fb5fb8e770f service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] No waiting events found dispatching network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:09 user nova-compute[75292]: WARNING nova.compute.manager [req-2bc6babb-c023-4367-9e8c-f7cf8beea4b4 req-059c07ab-7978-4fac-a6a6-6fb5fb8e770f service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received unexpected event network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef for instance with vm_state building and task_state spawning.
Nov 14 14:51:09 user nova-compute[75292]: INFO nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Took 5.33 seconds to spawn the instance on the hypervisor.
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:09 user nova-compute[75292]: INFO nova.compute.manager [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Detaching volume 4dbf570e-2345-469d-9da5-f5958f704152
Nov 14 14:51:09 user nova-compute[75292]: INFO nova.compute.manager [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Took 6.06 seconds to build instance.
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d23b4c5a-faf6-4d63-b623-9d8535f52b24 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.150s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:09 user nova-compute[75292]: INFO nova.virt.block_device [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Attempting to driver detach volume 4dbf570e-2345-469d-9da5-f5958f704152 from mountpoint /dev/vdb
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Attempting to detach device vdb from instance 7406189e-7077-4c43-bea1-5d3c5a5781aa from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:51:09 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:51:09 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:51:09 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:51:09 user nova-compute[75292]:   <serial>4dbf570e-2345-469d-9da5-f5958f704152</serial>
Nov 14 14:51:09 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:51:09 user nova-compute[75292]: </disk>
Nov 14 14:51:09 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:51:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully detached device vdb from instance 7406189e-7077-4c43-bea1-5d3c5a5781aa from the persistent domain config.
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7406189e-7077-4c43-bea1-5d3c5a5781aa from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:51:09 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:51:09 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:51:09 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:51:09 user nova-compute[75292]:   <serial>4dbf570e-2345-469d-9da5-f5958f704152</serial>
Nov 14 14:51:09 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:51:09 user nova-compute[75292]: </disk>
Nov 14 14:51:09 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:51:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:12 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:51:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:51:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:51:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:15 user nova-compute[75292]: INFO nova.compute.manager [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Terminating instance
Nov 14 14:51:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-58b53fc4-b833-4a0f-ab0b-4898a5cee781 req-489941d0-f737-4ae1-ad52-c38d8290c756 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58b53fc4-b833-4a0f-ab0b-4898a5cee781 req-489941d0-f737-4ae1-ad52-c38d8290c756 service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58b53fc4-b833-4a0f-ab0b-4898a5cee781 req-489941d0-f737-4ae1-ad52-c38d8290c756 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58b53fc4-b833-4a0f-ab0b-4898a5cee781 req-489941d0-f737-4ae1-ad52-c38d8290c756 service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-58b53fc4-b833-4a0f-ab0b-4898a5cee781 req-489941d0-f737-4ae1-ad52-c38d8290c756 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-58b53fc4-b833-4a0f-ab0b-4898a5cee781 req-489941d0-f737-4ae1-ad52-c38d8290c756 service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Instance destroyed successfully.
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'resources' on Instance uuid 45f14d3a-a81c-44f0-921f-0816b4e193bb {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1090877024',display_name='tempest-ServerActionsTestOtherA-server-1090877024',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1090877024',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:46:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-khi3cfpz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=45f14d3a-a81c-44f0-921f-0816b4e193bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "address": "fa:16:3e:7a:7e:8a", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaf2e6af-af", "ovs_interfaceid": "aaf2e6af-af4a-4632-95e5-73f7a28ce01e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_vif [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaf2e6af-af, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f61ffcc-ea8c-4558-b4a7-1ee413062d50) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:16 user nova-compute[75292]: INFO os_vif [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:7e:8a,bridge_name='br-int',has_traffic_filtering=True,id=aaf2e6af-af4a-4632-95e5-73f7a28ce01e,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaf2e6af-af')
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjyqmeBc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:51:16 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adc4e7f-2aa9-4453-8978-b1984a215628]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:51:16 user nova-compute[75292]: No targets found.
Nov 14 14:51:16 user nova-compute[75292]: iSNS:
Nov 14 14:51:16 user nova-compute[75292]: No targets found.
Nov 14 14:51:16 user nova-compute[75292]: STATIC:
Nov 14 14:51:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:51:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91
Nov 14 14:51:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad
Nov 14 14:51:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152
Nov 14 14:51:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:16 user nova-compute[75292]: FIRMWARE:
Nov 14 14:51:16 user nova-compute[75292]: No targets found.
Nov 14 14:51:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:51:16 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:51:16 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d38ab08-95f7-452d-9500-49344d422921]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9252ee-af7a-44fc-b42c-11914927b64e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:16 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:51:16 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:16 user nova-compute[75292]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)
Nov 14 14:51:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:16 user nova-compute[75292]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 (non-flash)
Nov 14 14:51:16 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:16 user nova-compute[75292]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)
Nov 14 14:51:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b74204ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd97e8-c265-4663-a1bd-2f3dc74b116b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.033s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec4a7a6-576e-412a-b6d4-ca543e1d150d]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00dac82-1687-4722-808c-f89e224e5961]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb78ca7-8c38-4199-b326-474b6e22d23f]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[38047bef-687b-473f-a99c-097377feb92c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6101cf4-4785-4a49-a919-dbbd5d4493e8]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260]
Nov 14 14:51:16 user nova-compute[75292]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91, portal: 172.16.0.220,3260] successful.
Nov 14 14:51:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[106ca89f-520d-46a8-b5c3-b8dda6e69b12]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] <== disconnect_volume: return (366ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:51:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Deleting instance files /opt/stack/data/nova/instances/45f14d3a-a81c-44f0-921f-0816b4e193bb_del
Nov 14 14:51:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Deletion of /opt/stack/data/nova/instances/45f14d3a-a81c-44f0-921f-0816b4e193bb_del complete
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:16 user nova-compute[75292]: INFO nova.compute.manager [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 14:51:16 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:51:16 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:51:17 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Took 0.70 seconds to deallocate network for instance.
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:17 user nova-compute[75292]: WARNING nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state deleting.
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:17 user nova-compute[75292]: WARNING nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state deleting.
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:17 user nova-compute[75292]: WARNING nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state deleting.
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-unplugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Acquiring lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] No waiting events found dispatching network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:17 user nova-compute[75292]: WARNING nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received unexpected event network-vif-plugged-aaf2e6af-af4a-4632-95e5-73f7a28ce01e for instance with vm_state active and task_state deleting.
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb0e7ff4-18ed-4e32-8181-d7a9c66671b5 req-7f7c1bcc-ae94-4ea3-99c1-b6f7ed341d4c service nova] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Received event network-vif-deleted-aaf2e6af-af4a-4632-95e5-73f7a28ce01e {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:17 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:18 user nova-compute[75292]: INFO nova.compute.manager [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 14:51:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: 45f14d3a-a81c-44f0-921f-0816b4e193bb] Deleting volume: 8cdefa72-53da-4b8f-ac20-4f0b9fa36b91 {{(pid=75292) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:18 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Deleted allocations for instance 45f14d3a-a81c-44f0-921f-0816b4e193bb
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-129b9549-22eb-4b77-8b51-273f262ed38a tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "45f14d3a-a81c-44f0-921f-0816b4e193bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.348s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:51:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:51:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8153MB free_disk=25.29235076904297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7406189e-7077-4c43-bea1-5d3c5a5781aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f867ca7d-4cc6-472c-8ee6-a279a35f34ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 52818903-146d-429a-893e-3f6da6a8a17c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:51:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:51:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:51:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:30 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7406189e-7077-4c43-bea1-5d3c5a5781aa is timed out.
Nov 14 14:51:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully detached device vdb from instance 7406189e-7077-4c43-bea1-5d3c5a5781aa from the live domain config.
Nov 14 14:51:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwTomraI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:51:30 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[beafd375-0434-4c69-a9a4-13bbce553023]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:51:30 user nova-compute[75292]: No targets found.
Nov 14 14:51:30 user nova-compute[75292]: iSNS:
Nov 14 14:51:30 user nova-compute[75292]: No targets found.
Nov 14 14:51:30 user nova-compute[75292]: STATIC:
Nov 14 14:51:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:51:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad
Nov 14 14:51:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:30 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152
Nov 14 14:51:30 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:30 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:30 user nova-compute[75292]: FIRMWARE:
Nov 14 14:51:30 user nova-compute[75292]: No targets found.
Nov 14 14:51:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:51:30 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:51:30 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e91d641-06f9-4647-a1e4-7ddd1048711f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2431b976-e4e3-4430-b8ea-f4a89b61469a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:30 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:30 user nova-compute[75292]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)
Nov 14 14:51:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:30 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:30 user nova-compute[75292]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 (non-flash)
Nov 14 14:51:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b3063ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b94b91-473f-41fd-b5fb-f30284de73e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3f60c-90b2-43f0-87bd-c454de6957b7]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[16834945-9d64-40f6-8a1c-37040270ecac]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9612b3e8-7438-46c7-a822-28e34f36b6f6]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6695037-b53a-4e3a-94fb-3cb128853431]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c505dab-e035-4f5c-ade9-79ffcbd2fe01]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260]
Nov 14 14:51:30 user nova-compute[75292]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152, portal: 172.16.0.220,3260] successful.
Nov 14 14:51:30 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad7c284-46d3-4a8d-9276-545b3ca1f633]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== disconnect_volume: return (285ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:51:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG nova.objects.instance [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'flavor' on Instance uuid 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-be790d36-76ed-4b79-8e97-6d6d714e2df0 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.701s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.592s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:31 user nova-compute[75292]: INFO nova.compute.manager [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Terminating instance
Nov 14 14:51:31 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-5202c190-19df-46f7-8d38-c002f3d2e3d6 req-1604c3b0-ae12-41a6-8ac3-bab88d358b06 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-vif-unplugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5202c190-19df-46f7-8d38-c002f3d2e3d6 req-1604c3b0-ae12-41a6-8ac3-bab88d358b06 service nova] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5202c190-19df-46f7-8d38-c002f3d2e3d6 req-1604c3b0-ae12-41a6-8ac3-bab88d358b06 service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5202c190-19df-46f7-8d38-c002f3d2e3d6 req-1604c3b0-ae12-41a6-8ac3-bab88d358b06 service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-5202c190-19df-46f7-8d38-c002f3d2e3d6 req-1604c3b0-ae12-41a6-8ac3-bab88d358b06 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] No waiting events found dispatching network-vif-unplugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-5202c190-19df-46f7-8d38-c002f3d2e3d6 req-1604c3b0-ae12-41a6-8ac3-bab88d358b06 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-vif-unplugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:51:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Instance destroyed successfully.
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'resources' on Instance uuid 7406189e-7077-4c43-bea1-5d3c5a5781aa {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:49:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1496227372',display_name='tempest-VolumesSnapshotTestJSON-instance-1496227372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1496227372',id=31,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF15IiGbh0Mtk7QE95ovCiZVMsKTQpa1WVCJhbU1oIGgoY8DW6P48Ys8dk3FnZaBuxFLn9ygKY+W8/u9U8Ucmdn3EjaVdUNlvzqTYcfTdbmgocifSWLRhvEjXAqXxIs3Q==',key_name='tempest-keypair-1919413428',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:49:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f986a9cc69146d58b322282d38eb722',ramdisk_id='',reservation_id='r-s4zn2qy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-641028471',owner_user_name='tempest-VolumesSnapshotTestJSON-641028471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:49:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2a969f8d924908b94319b09da16949',uuid=7406189e-7077-4c43-bea1-5d3c5a5781aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converting VIF {"id": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "address": "fa:16:3e:19:97:02", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f53ada9-9e", "ovs_interfaceid": "7f53ada9-9e21-4c8a-945d-723bc6fb89a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_vif [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f53ada9-9e, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c00b39d-2fd4-44ff-94a9-a3a6abd7ca02) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:32 user nova-compute[75292]: INFO os_vif [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:97:02,bridge_name='br-int',has_traffic_filtering=True,id=7f53ada9-9e21-4c8a-945d-723bc6fb89a5,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f53ada9-9e')
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwTomraI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:51:32 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6589fc7f-4d8c-4d80-805c-355339888335]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:51:32 user nova-compute[75292]: No targets found.
Nov 14 14:51:32 user nova-compute[75292]: iSNS:
Nov 14 14:51:32 user nova-compute[75292]: No targets found.
Nov 14 14:51:32 user nova-compute[75292]: STATIC:
Nov 14 14:51:32 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:51:32 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:32 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:32 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad
Nov 14 14:51:32 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:32 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:32 user nova-compute[75292]: FIRMWARE:
Nov 14 14:51:32 user nova-compute[75292]: No targets found.
Nov 14 14:51:32 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:51:32 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:51:32 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dbf570e-2345-469d-9da5-f5958f704152', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e863651-751f-4736-b8ca-f61540cf2396]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0178f82f-5211-4106-9474-ccc96c9f89c5]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:32 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:32 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:32 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:32 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b540fca60>, {}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Disconnecting from: [] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== disconnect_volume: return (67ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:51:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Deleting instance files /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa_del
Nov 14 14:51:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Deletion of /opt/stack/data/nova/instances/7406189e-7077-4c43-bea1-5d3c5a5781aa_del complete
Nov 14 14:51:32 user nova-compute[75292]: INFO nova.compute.manager [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 14:51:32 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:51:32 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:51:33 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Took 0.67 seconds to deallocate network for instance.
Nov 14 14:51:33 user nova-compute[75292]: WARNING nova.volume.cinder [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Attachment 2ce532b8-f71c-4aad-926b-41f3109bf12c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2ce532b8-f71c-4aad-926b-41f3109bf12c. (HTTP 404) (Request-ID: req-b9da2300-0ee7-4c07-8940-1dc65e8ee881)
Nov 14 14:51:33 user nova-compute[75292]: INFO nova.compute.manager [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:33 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Deleted allocations for instance 7406189e-7077-4c43-bea1-5d3c5a5781aa
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a2a99502-9b4f-4cae-a571-e067394adabe tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] Acquiring lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] Lock "7406189e-7077-4c43-bea1-5d3c5a5781aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] No waiting events found dispatching network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:33 user nova-compute[75292]: WARNING nova.compute.manager [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received unexpected event network-vif-plugged-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 for instance with vm_state deleted and task_state None.
Nov 14 14:51:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-45c54485-33aa-4246-b6ee-c1f8a83f5f89 req-c4957ba4-f136-4655-8559-8fa7916fe793 service nova] [instance: 7406189e-7077-4c43-bea1-5d3c5a5781aa] Received event network-vif-deleted-7f53ada9-9e21-4c8a-945d-723bc6fb89a5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:51:36 user nova-compute[75292]: INFO nova.compute.manager [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] instance snapshotting
Nov 14 14:51:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Beginning live snapshot process
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpipm52iuy/a6134ef87bda47febdefdf6fee216adf.delta 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpipm52iuy/a6134ef87bda47febdefdf6fee216adf.delta 1073741824" returned: 0 in 0.053s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 14:51:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:51:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:51:38 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 14:51:39 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:51:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpipm52iuy/a6134ef87bda47febdefdf6fee216adf.delta /opt/stack/data/nova/instances/snapshots/tmpipm52iuy/a6134ef87bda47febdefdf6fee216adf {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpipm52iuy/a6134ef87bda47febdefdf6fee216adf.delta /opt/stack/data/nova/instances/snapshots/tmpipm52iuy/a6134ef87bda47febdefdf6fee216adf" returned: 0 in 0.436s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Snapshot extracted, beginning image upload
Nov 14 14:51:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Snapshot image upload complete
Nov 14 14:51:41 user nova-compute[75292]: INFO nova.compute.manager [None req-78f630eb-0495-4c32-b279-1b5ce653c227 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Took 4.99 seconds to snapshot the instance on the hypervisor.
Nov 14 14:51:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:57 user nova-compute[75292]: INFO nova.compute.manager [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Terminating instance
Nov 14 14:51:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3e96f9e-3e9a-440d-a46b-91867aa4acff req-af0548a8-c5c6-4bed-b44d-0dc659f7aa5b service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-unplugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3e96f9e-3e9a-440d-a46b-91867aa4acff req-af0548a8-c5c6-4bed-b44d-0dc659f7aa5b service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3e96f9e-3e9a-440d-a46b-91867aa4acff req-af0548a8-c5c6-4bed-b44d-0dc659f7aa5b service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3e96f9e-3e9a-440d-a46b-91867aa4acff req-af0548a8-c5c6-4bed-b44d-0dc659f7aa5b service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3e96f9e-3e9a-440d-a46b-91867aa4acff req-af0548a8-c5c6-4bed-b44d-0dc659f7aa5b service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-unplugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:51:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3e96f9e-3e9a-440d-a46b-91867aa4acff req-af0548a8-c5c6-4bed-b44d-0dc659f7aa5b service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-unplugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Instance destroyed successfully.
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.objects.instance [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'resources' on Instance uuid f867ca7d-4cc6-472c-8ee6-a279a35f34ed {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:50:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-966436112',display_name='tempest-TestVolumeBootPattern-server-966436112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-966436112',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:50:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-o0yngcau',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:50:23Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=f867ca7d-4cc6-472c-8ee6-a279a35f34ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "address": "fa:16:3e:6b:df:4b", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6b3b03-d3", "ovs_interfaceid": "5c6b3b03-d3f2-4090-aceb-9867741c9911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_vif [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c6b3b03-d3, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0450c4b-7730-4009-bd79-e02dfc0956b7) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: INFO os_vif [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:df:4b,bridge_name='br-int',has_traffic_filtering=True,id=5c6b3b03-d3f2-4090-aceb-9867741c9911,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6b3b03-d3')
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOIhmzyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:51:58 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3ada3-e402-42b4-a59c-71d889ba6792]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:51:58 user nova-compute[75292]: No targets found.
Nov 14 14:51:58 user nova-compute[75292]: iSNS:
Nov 14 14:51:58 user nova-compute[75292]: No targets found.
Nov 14 14:51:58 user nova-compute[75292]: STATIC:
Nov 14 14:51:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:51:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad
Nov 14 14:51:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:51:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:51:58 user nova-compute[75292]: FIRMWARE:
Nov 14 14:51:58 user nova-compute[75292]: No targets found.
Nov 14 14:51:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:51:58 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:51:58 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1ee14-bbab-45a9-9594-f7a40fcc8a0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89b5817-e74a-4681-b001-0dec1abe0c8a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:58 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:51:58 user nova-compute[75292]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad (non-flash)
Nov 14 14:51:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b3063cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc591af2-cd9f-4b6b-ac43-629a84e74cab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c0267f-f761-4c5c-85e8-a8042dcfa152]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c934b8-d733-48dd-a342-3a901a25383a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f136253-c78f-4b24-b667-6c8bea3ee4d6]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e04b44b-2e4b-4e63-83fa-acad6a27bf7a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b18326-cd0a-4dbb-adf6-fa8d5ec2516c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260]
Nov 14 14:51:58 user nova-compute[75292]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad, portal: 172.16.0.220,3260] successful.
Nov 14 14:51:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd83340c-c405-4a66-ab7e-f2a72e2dd8ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0422a8-9ce5-47fe-b772-45c57c49a711]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== disconnect_volume: return (354ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:51:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Deleting instance files /opt/stack/data/nova/instances/f867ca7d-4cc6-472c-8ee6-a279a35f34ed_del
Nov 14 14:51:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Deletion of /opt/stack/data/nova/instances/f867ca7d-4cc6-472c-8ee6-a279a35f34ed_del complete
Nov 14 14:51:58 user nova-compute[75292]: INFO nova.compute.manager [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 14 14:51:58 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:51:58 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:51:59 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:51:59 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Took 0.41 seconds to deallocate network for instance.
Nov 14 14:51:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-8367433c-d0ff-45ba-9ca8-6744a5969edd req-b77721f1-1506-48dc-a704-2a9ec6cca4c8 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-deleted-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:00 user nova-compute[75292]: WARNING nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received unexpected event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with vm_state active and task_state deleting.
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:00 user nova-compute[75292]: WARNING nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received unexpected event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with vm_state active and task_state deleting.
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:00 user nova-compute[75292]: WARNING nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received unexpected event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with vm_state active and task_state deleting.
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-unplugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-unplugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-unplugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Acquiring lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] No waiting events found dispatching network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:00 user nova-compute[75292]: WARNING nova.compute.manager [req-c1fae750-3f16-48e5-991f-78590be7ab6d req-94ddbddf-c7fc-4e2d-843b-644787bfce91 service nova] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Received unexpected event network-vif-plugged-5c6b3b03-d3f2-4090-aceb-9867741c9911 for instance with vm_state active and task_state deleting.
Nov 14 14:52:00 user nova-compute[75292]: INFO nova.compute.manager [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.manager [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: f867ca7d-4cc6-472c-8ee6-a279a35f34ed] Deleting volume: dd83340c-c405-4a66-ab7e-f2a72e2dd8ad {{(pid=75292) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:00 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Deleted allocations for instance f867ca7d-4cc6-472c-8ee6-a279a35f34ed
Nov 14 14:52:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-654ff8dd-17a7-4300-860d-d0dcbd457ef4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "f867ca7d-4cc6-472c-8ee6-a279a35f34ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.152s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:08 user nova-compute[75292]: INFO nova.compute.manager [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Terminating instance
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-8b7eb116-b262-4776-bea3-450c9b307d18 req-e6e58536-7257-48cd-8d54-4330e22acbd2 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-vif-unplugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8b7eb116-b262-4776-bea3-450c9b307d18 req-e6e58536-7257-48cd-8d54-4330e22acbd2 service nova] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8b7eb116-b262-4776-bea3-450c9b307d18 req-e6e58536-7257-48cd-8d54-4330e22acbd2 service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8b7eb116-b262-4776-bea3-450c9b307d18 req-e6e58536-7257-48cd-8d54-4330e22acbd2 service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-8b7eb116-b262-4776-bea3-450c9b307d18 req-e6e58536-7257-48cd-8d54-4330e22acbd2 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] No waiting events found dispatching network-vif-unplugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-8b7eb116-b262-4776-bea3-450c9b307d18 req-e6e58536-7257-48cd-8d54-4330e22acbd2 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-vif-unplugged-efebda64-96d8-427d-b777-b43803cb2e92 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Instance destroyed successfully.
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.objects.instance [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lazy-loading 'resources' on Instance uuid c75f05cb-4b25-4c55-81f6-4853a6ee4938 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1619315554',display_name='tempest-ServerActionsTestOtherA-server-1619315554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1619315554',id=4,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILBbj/PLvd2j4BzgEvpkrj0AZnqv8rmhZgKiPdIvS36xoG0AQOcTBKnpTv58weQ3xpL2su8QWs4OpO4ZLK/mSzBKh7+JyCCiNzP21cn/cbmaYCeVcaGTlKnzeNkzHdCFQ==',key_name='tempest-keypair-1575354809',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='54b7e88c2e88460484f06a772b1f60c3',ramdisk_id='',reservation_id='r-yuzz3ojn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1545988335',owner_user_name='tempest-ServerActionsTestOtherA-1545988335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:33:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e75042706a2347ebba11d20ba65ba282',uuid=c75f05cb-4b25-4c55-81f6-4853a6ee4938,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converting VIF {"id": "efebda64-96d8-427d-b777-b43803cb2e92", "address": "fa:16:3e:12:40:c0", "network": {"id": "3976497a-ebec-4d45-9398-8f32f3f93e82", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1227730880-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "54b7e88c2e88460484f06a772b1f60c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefebda64-96", "ovs_interfaceid": "efebda64-96d8-427d-b777-b43803cb2e92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG os_vif [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefebda64-96, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b465efa1-6a1f-4065-b469-79f8c3ddf843) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:08 user nova-compute[75292]: INFO os_vif [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=efebda64-96d8-427d-b777-b43803cb2e92,network=Network(3976497a-ebec-4d45-9398-8f32f3f93e82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefebda64-96')
Nov 14 14:52:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Deleting instance files /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938_del
Nov 14 14:52:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Deletion of /opt/stack/data/nova/instances/c75f05cb-4b25-4c55-81f6-4853a6ee4938_del complete
Nov 14 14:52:08 user nova-compute[75292]: INFO nova.compute.manager [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 14 14:52:08 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:52:08 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:09 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Took 0.61 seconds to deallocate network for instance.
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-e168416e-2bc8-479d-afe9-23db37d7d46e req-8e6afad2-8dcc-4b33-9583-fd86f0b67f97 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-vif-deleted-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:09 user nova-compute[75292]: INFO nova.compute.manager [req-e168416e-2bc8-479d-afe9-23db37d7d46e req-8e6afad2-8dcc-4b33-9583-fd86f0b67f97 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Neutron deleted interface efebda64-96d8-427d-b777-b43803cb2e92; detaching it from the instance and deleting it from the info cache
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-e168416e-2bc8-479d-afe9-23db37d7d46e req-8e6afad2-8dcc-4b33-9583-fd86f0b67f97 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-e168416e-2bc8-479d-afe9-23db37d7d46e req-8e6afad2-8dcc-4b33-9583-fd86f0b67f97 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Detach interface failed, port_id=efebda64-96d8-427d-b777-b43803cb2e92, reason: Instance c75f05cb-4b25-4c55-81f6-4853a6ee4938 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:09 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Deleted allocations for instance c75f05cb-4b25-4c55-81f6-4853a6ee4938
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-89338742-8231-40b9-88e4-9d31a3a87f37 tempest-ServerActionsTestOtherA-1545988335 tempest-ServerActionsTestOtherA-1545988335-project-member] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:09 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:52:09 user nova-compute[75292]: INFO nova.compute.claims [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Claim successful on node user
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-4f219b75-7f97-4e97-9d8a-85448b6b7d62 req-54efd028-c45d-4076-8dd6-0b1776ae3be1 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received event network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4f219b75-7f97-4e97-9d8a-85448b6b7d62 req-54efd028-c45d-4076-8dd6-0b1776ae3be1 service nova] Acquiring lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4f219b75-7f97-4e97-9d8a-85448b6b7d62 req-54efd028-c45d-4076-8dd6-0b1776ae3be1 service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4f219b75-7f97-4e97-9d8a-85448b6b7d62 req-54efd028-c45d-4076-8dd6-0b1776ae3be1 service nova] Lock "c75f05cb-4b25-4c55-81f6-4853a6ee4938-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-4f219b75-7f97-4e97-9d8a-85448b6b7d62 req-54efd028-c45d-4076-8dd6-0b1776ae3be1 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] No waiting events found dispatching network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:10 user nova-compute[75292]: WARNING nova.compute.manager [req-4f219b75-7f97-4e97-9d8a-85448b6b7d62 req-54efd028-c45d-4076-8dd6-0b1776ae3be1 service nova] [instance: c75f05cb-4b25-4c55-81f6-4853a6ee4938] Received unexpected event network-vif-plugged-efebda64-96d8-427d-b777-b43803cb2e92 for instance with vm_state deleted and task_state None.
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:52:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.policy [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1d2a969f8d924908b94319b09da16949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f986a9cc69146d58b322282d38eb722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:52:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Creating image(s)
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "/opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "/opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk 1073741824" returned: 0 in 0.046s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Successfully created port: 34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Cannot resize image /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Ensure instance console log exists: /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Successfully updated port: 34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquired lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-changed-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Refreshing instance network info cache due to event network-changed-34b97837-d647-4ae4-90dc-771f16198958. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] Acquiring lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updating instance_info_cache with network_info: [{"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Releasing lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Instance network_info: |[{"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] Acquired lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Refreshing network info cache for port 34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Start _get_guest_xml network_info=[{"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:52:12 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:52:12 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1804736052',display_name='tempest-VolumesSnapshotTestJSON-instance-1804736052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1804736052',id=35,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgthYssI0hDrbcvzCNh+69HwFPBdncnp4YU+q94Y+PKImbn+iEBbd3CA9s4eax8Mp70um9L+76YO97TB53w68Ti5o616JUm7Y73DyL+k94hlwLojYiaT8y9jBnOCK9O8A==',key_name='tempest-keypair-1735419335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f986a9cc69146d58b322282d38eb722',ramdisk_id='',reservation_id='r-g96hseqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-641028471',owner_user_name='tempest-VolumesSnapshotTestJSON-641028471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2a969f8d924908b94319b09da16949',uuid=0a0d84e0-be0b-497e-ba06-b71db5cdc5d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converting VIF {"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:52:12 user nova-compute[75292]:   <uuid>0a0d84e0-be0b-497e-ba06-b71db5cdc5d4</uuid>
Nov 14 14:52:12 user nova-compute[75292]:   <name>instance-00000023</name>
Nov 14 14:52:12 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:52:12 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:52:12 user nova-compute[75292]:   <metadata>
Nov 14 14:52:12 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:52:12 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:52:12 user nova-compute[75292]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1804736052</nova:name>
Nov 14 14:52:12 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:52:12</nova:creationTime>
Nov 14 14:52:12 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:52:12 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:52:12 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:52:12 user nova-compute[75292]:       <nova:owner>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:user uuid="1d2a969f8d924908b94319b09da16949">tempest-VolumesSnapshotTestJSON-641028471-project-member</nova:user>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:project uuid="0f986a9cc69146d58b322282d38eb722">tempest-VolumesSnapshotTestJSON-641028471</nova:project>
Nov 14 14:52:12 user nova-compute[75292]:       </nova:owner>
Nov 14 14:52:12 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:52:12 user nova-compute[75292]:       <nova:ports>
Nov 14 14:52:12 user nova-compute[75292]:         <nova:port uuid="34b97837-d647-4ae4-90dc-771f16198958">
Nov 14 14:52:12 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 14:52:12 user nova-compute[75292]:         </nova:port>
Nov 14 14:52:12 user nova-compute[75292]:       </nova:ports>
Nov 14 14:52:12 user nova-compute[75292]:     </nova:instance>
Nov 14 14:52:12 user nova-compute[75292]:   </metadata>
Nov 14 14:52:12 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:52:12 user nova-compute[75292]:     <system>
Nov 14 14:52:12 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:52:12 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:52:12 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:52:12 user nova-compute[75292]:       <entry name="serial">0a0d84e0-be0b-497e-ba06-b71db5cdc5d4</entry>
Nov 14 14:52:12 user nova-compute[75292]:       <entry name="uuid">0a0d84e0-be0b-497e-ba06-b71db5cdc5d4</entry>
Nov 14 14:52:12 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:52:12 user nova-compute[75292]:     </system>
Nov 14 14:52:12 user nova-compute[75292]:   </sysinfo>
Nov 14 14:52:12 user nova-compute[75292]:   <os>
Nov 14 14:52:12 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:52:12 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:52:12 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:52:12 user nova-compute[75292]:   </os>
Nov 14 14:52:12 user nova-compute[75292]:   <features>
Nov 14 14:52:12 user nova-compute[75292]:     <acpi/>
Nov 14 14:52:12 user nova-compute[75292]:     <apic/>
Nov 14 14:52:12 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:52:12 user nova-compute[75292]:   </features>
Nov 14 14:52:12 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:52:12 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:52:12 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:52:12 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:52:12 user nova-compute[75292]:   </clock>
Nov 14 14:52:12 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:52:12 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:52:12 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:52:12 user nova-compute[75292]:   </cpu>
Nov 14 14:52:12 user nova-compute[75292]:   <devices>
Nov 14 14:52:12 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:52:12 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:52:12 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk"/>
Nov 14 14:52:12 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:52:12 user nova-compute[75292]:     </disk>
Nov 14 14:52:12 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:52:12 user nova-compute[75292]:       <mac address="fa:16:3e:4c:89:74"/>
Nov 14 14:52:12 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:52:12 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:52:12 user nova-compute[75292]:       <target dev="tap34b97837-d6"/>
Nov 14 14:52:12 user nova-compute[75292]:     </interface>
Nov 14 14:52:12 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:52:12 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/console.log" append="off"/>
Nov 14 14:52:12 user nova-compute[75292]:     </serial>
Nov 14 14:52:12 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:52:12 user nova-compute[75292]:     <video>
Nov 14 14:52:12 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:52:12 user nova-compute[75292]:     </video>
Nov 14 14:52:12 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:52:12 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:52:12 user nova-compute[75292]:     </rng>
Nov 14 14:52:12 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:52:12 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:52:12 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:52:12 user nova-compute[75292]:     </memballoon>
Nov 14 14:52:12 user nova-compute[75292]:   </devices>
Nov 14 14:52:12 user nova-compute[75292]: </domain>
Nov 14 14:52:12 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1804736052',display_name='tempest-VolumesSnapshotTestJSON-instance-1804736052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1804736052',id=35,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgthYssI0hDrbcvzCNh+69HwFPBdncnp4YU+q94Y+PKImbn+iEBbd3CA9s4eax8Mp70um9L+76YO97TB53w68Ti5o616JUm7Y73DyL+k94hlwLojYiaT8y9jBnOCK9O8A==',key_name='tempest-keypair-1735419335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f986a9cc69146d58b322282d38eb722',ramdisk_id='',reservation_id='r-g96hseqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-641028471',owner_user_name='tempest-VolumesSnapshotTestJSON-641028471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2a969f8d924908b94319b09da16949',uuid=0a0d84e0-be0b-497e-ba06-b71db5cdc5d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converting VIF {"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG os_vif [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ea805a0-13fb-565b-825a-278bbf72cf5d', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34b97837-d6, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34b97837-d6, col_values=(('qos', UUID('5efd183f-4ce6-4bcb-8424-2a75a2b21262')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34b97837-d6, col_values=(('external_ids', {'iface-id': '34b97837-d647-4ae4-90dc-771f16198958', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:89:74', 'vm-uuid': '0a0d84e0-be0b-497e-ba06-b71db5cdc5d4'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:12 user nova-compute[75292]: INFO os_vif [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6')
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No VIF found with MAC fa:16:3e:4c:89:74, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updated VIF entry in instance network info cache for port 34b97837-d647-4ae4-90dc-771f16198958. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updating instance_info_cache with network_info: [{"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e1724148-44e2-4c2a-bdfc-6d91871be0fa req-c8951eb1-d9ff-4c0f-a51f-2ed2278779b6 service nova] Releasing lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-91901721-6d06-4b55-9ecd-f8f30bc18787 req-08cea081-0153-4ff2-8542-83f3c72fedee service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-91901721-6d06-4b55-9ecd-f8f30bc18787 req-08cea081-0153-4ff2-8542-83f3c72fedee service nova] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-91901721-6d06-4b55-9ecd-f8f30bc18787 req-08cea081-0153-4ff2-8542-83f3c72fedee service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-91901721-6d06-4b55-9ecd-f8f30bc18787 req-08cea081-0153-4ff2-8542-83f3c72fedee service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-91901721-6d06-4b55-9ecd-f8f30bc18787 req-08cea081-0153-4ff2-8542-83f3c72fedee service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] No waiting events found dispatching network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:13 user nova-compute[75292]: WARNING nova.compute.manager [req-91901721-6d06-4b55-9ecd-f8f30bc18787 req-08cea081-0153-4ff2-8542-83f3c72fedee service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received unexpected event network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 for instance with vm_state building and task_state spawning.
Nov 14 14:52:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:52:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Instance spawned successfully.
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:15 user nova-compute[75292]: INFO nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-6055e090-aeb8-4b12-8c4f-020327441b16 req-bdaa6cc9-de09-4e97-b4a8-1f2afd4feb18 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6055e090-aeb8-4b12-8c4f-020327441b16 req-bdaa6cc9-de09-4e97-b4a8-1f2afd4feb18 service nova] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6055e090-aeb8-4b12-8c4f-020327441b16 req-bdaa6cc9-de09-4e97-b4a8-1f2afd4feb18 service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6055e090-aeb8-4b12-8c4f-020327441b16 req-bdaa6cc9-de09-4e97-b4a8-1f2afd4feb18 service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-6055e090-aeb8-4b12-8c4f-020327441b16 req-bdaa6cc9-de09-4e97-b4a8-1f2afd4feb18 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] No waiting events found dispatching network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:15 user nova-compute[75292]: WARNING nova.compute.manager [req-6055e090-aeb8-4b12-8c4f-020327441b16 req-bdaa6cc9-de09-4e97-b4a8-1f2afd4feb18 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received unexpected event network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 for instance with vm_state building and task_state spawning.
Nov 14 14:52:15 user nova-compute[75292]: INFO nova.compute.manager [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Took 5.73 seconds to build instance.
Nov 14 14:52:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b09873e4-e64b-4b31-8901-50fe0a9e4814 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.821s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:52:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:52:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:19 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:52:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:21 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:52:21 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8506MB free_disk=25.245059967041016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 52818903-146d-429a-893e-3f6da6a8a17c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:52:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:52:22 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:52:22 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:52:22 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:52:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:52:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:52:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:52:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:52:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:52:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:52:43 user nova-compute[75292]: INFO nova.compute.claims [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Claim successful on node user
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:52:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:52:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:52:43 user nova-compute[75292]: INFO nova.virt.block_device [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Booting with volume-backed-image bf213fca-dee8-42b3-bde7-bb229ab5915b at /dev/vda
Nov 14 14:52:44 user nova-compute[75292]: DEBUG nova.policy [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38a8da6883ae40c4b12c8c483d598a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ef654d69c34328893549c7a124aebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:52:44 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Successfully created port: 53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:52:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Successfully updated port: 53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-changed-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Refreshing instance network info cache due to event network-changed-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] Acquiring lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG nova.network.neutron [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating instance_info_cache with network_info: [{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance network_info: |[{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] Acquired lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG nova.network.neutron [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Refreshing network info cache for port 53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG nova.network.neutron [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updated VIF entry in instance network info cache for port 53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG nova.network.neutron [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating instance_info_cache with network_info: [{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c2ffafcb-3ff0-4d68-9737-5a768b3d1bf9 req-a736f8b8-af11-476a-acbc-34a14daea826 service nova] Releasing lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG os_brick.utils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e94f08a-aa12-4ee6-9431-14c7ca0f2392]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f5f1c-7358-4c38-a116-8b170cd432e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b860ed-d292-4bd1-9249-43f6291abade]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90929bf-a587-4710-af89-10753d8f61c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:52:49 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:52:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc364825-47be-4557-8b13-a5d737979805]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG os_brick.utils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:52:49 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating existing volume attachment record: 77b86d5c-fee7-449f-b370-9f7446e51d94 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:52:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:52:54 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Creating image(s)
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Ensure instance console log exists: /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Start _get_guest_xml network_info=[{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77b86d5c-fee7-449f-b370-9f7446e51d94', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'adcd9c44-c430-46ea-986d-b4f7b7888122', 'attached_at': '', 'detached_at': '', 'volume_id': '78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'serial': '78c8c620-e8b2-4f4e-b93b-582a8bd791a9'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:52:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:52:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:52:54 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:52:54 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:52:54 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ed8db-dd21-4647-8a4c-011a0ebd5e98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:52:54 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[92178458-b199-4854-8559-5cbc44dd3102]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9] added
Nov 14 14:52:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21dae14-8c7e-4fb6-810b-30a760fc5ab7]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bcab8c-3f51-49fd-a2c8-96fa620de0f5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKANaJlz {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKANaJlz" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf688564-ead5-4edc-a91d-3b56e3cb8c6c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sKANaJlz'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[450c2215-a8ec-4bfd-81eb-ca9c86195b86]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[78559740-66cd-45f4-bd45-8cd7775c53e1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:52:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:52:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[859bfcdf-1cb6-4885-beaf-00bb436d67e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260]
Nov 14 14:52:54 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260] successful.
Nov 14 14:52:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3324afdc-7c18-4dde-a4ea-2a7bbb52f4ad]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb56ac1-489d-44e1-bb20-468b97a64c54]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:52:54 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:52:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:52:54 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:52:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.065s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d76db-3988-4b93-9178-69061e697a90]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-changed-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Refreshing instance network info cache due to event network-changed-8821ecbc-47fb-4114-b050-0969d765f1ef. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] Acquiring lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] Acquired lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG nova.network.neutron [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Refreshing network info cache for port 8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:52:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updated VIF entry in instance network info cache for port 8821ecbc-47fb-4114-b050-0969d765f1ef. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updating instance_info_cache with network_info: [{"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e0ea8c12-f95b-4be8-9088-9f8c37964d07 req-7dcb063e-acbb-445e-b622-8c7d982b17be service nova] Releasing lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26362383339613833', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383339613833', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488050270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488050270',id=36,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-gyl6gldd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:44Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=adcd9c44-c430-46ea-986d-b4f7b7888122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'pci_devices' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:52:55 user nova-compute[75292]:   <uuid>adcd9c44-c430-46ea-986d-b4f7b7888122</uuid>
Nov 14 14:52:55 user nova-compute[75292]:   <name>instance-00000024</name>
Nov 14 14:52:55 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:52:55 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:52:55 user nova-compute[75292]:   <metadata>
Nov 14 14:52:55 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:52:55 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:52:55 user nova-compute[75292]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1488050270</nova:name>
Nov 14 14:52:55 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:52:54</nova:creationTime>
Nov 14 14:52:55 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:52:55 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:52:55 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:52:55 user nova-compute[75292]:       <nova:owner>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:user uuid="38a8da6883ae40c4b12c8c483d598a40">tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member</nova:user>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:project uuid="60ef654d69c34328893549c7a124aebf">tempest-ServerBootFromVolumeStableRescueTest-172724502</nova:project>
Nov 14 14:52:55 user nova-compute[75292]:       </nova:owner>
Nov 14 14:52:55 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:52:55 user nova-compute[75292]:       <nova:ports>
Nov 14 14:52:55 user nova-compute[75292]:         <nova:port uuid="53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2">
Nov 14 14:52:55 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 14:52:55 user nova-compute[75292]:         </nova:port>
Nov 14 14:52:55 user nova-compute[75292]:       </nova:ports>
Nov 14 14:52:55 user nova-compute[75292]:     </nova:instance>
Nov 14 14:52:55 user nova-compute[75292]:   </metadata>
Nov 14 14:52:55 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:52:55 user nova-compute[75292]:     <system>
Nov 14 14:52:55 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:52:55 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:52:55 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:52:55 user nova-compute[75292]:       <entry name="serial">adcd9c44-c430-46ea-986d-b4f7b7888122</entry>
Nov 14 14:52:55 user nova-compute[75292]:       <entry name="uuid">adcd9c44-c430-46ea-986d-b4f7b7888122</entry>
Nov 14 14:52:55 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:52:55 user nova-compute[75292]:     </system>
Nov 14 14:52:55 user nova-compute[75292]:   </sysinfo>
Nov 14 14:52:55 user nova-compute[75292]:   <os>
Nov 14 14:52:55 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:52:55 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:52:55 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:52:55 user nova-compute[75292]:   </os>
Nov 14 14:52:55 user nova-compute[75292]:   <features>
Nov 14 14:52:55 user nova-compute[75292]:     <acpi/>
Nov 14 14:52:55 user nova-compute[75292]:     <apic/>
Nov 14 14:52:55 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:52:55 user nova-compute[75292]:   </features>
Nov 14 14:52:55 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:52:55 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:52:55 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:52:55 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:52:55 user nova-compute[75292]:   </clock>
Nov 14 14:52:55 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:52:55 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:52:55 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:52:55 user nova-compute[75292]:   </cpu>
Nov 14 14:52:55 user nova-compute[75292]:   <devices>
Nov 14 14:52:55 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:52:55 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:52:55 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:52:55 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:52:55 user nova-compute[75292]:       <serial>78c8c620-e8b2-4f4e-b93b-582a8bd791a9</serial>
Nov 14 14:52:55 user nova-compute[75292]:     </disk>
Nov 14 14:52:55 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:52:55 user nova-compute[75292]:       <mac address="fa:16:3e:2e:6b:88"/>
Nov 14 14:52:55 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:52:55 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:52:55 user nova-compute[75292]:       <target dev="tap53d5dd99-ff"/>
Nov 14 14:52:55 user nova-compute[75292]:     </interface>
Nov 14 14:52:55 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:52:55 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/console.log" append="off"/>
Nov 14 14:52:55 user nova-compute[75292]:     </serial>
Nov 14 14:52:55 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:52:55 user nova-compute[75292]:     <video>
Nov 14 14:52:55 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:52:55 user nova-compute[75292]:     </video>
Nov 14 14:52:55 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:52:55 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:52:55 user nova-compute[75292]:     </rng>
Nov 14 14:52:55 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:52:55 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:52:55 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:52:55 user nova-compute[75292]:     </memballoon>
Nov 14 14:52:55 user nova-compute[75292]:   </devices>
Nov 14 14:52:55 user nova-compute[75292]: </domain>
Nov 14 14:52:55 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488050270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488050270',id=36,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-gyl6gldd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:44Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=adcd9c44-c430-46ea-986d-b4f7b7888122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG os_vif [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beb195ff-0c37-53fb-aa12-7a143b2b642e', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53d5dd99-ff, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53d5dd99-ff, col_values=(('qos', UUID('c0a017df-248e-4b0f-a3d8-84836dab1183')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53d5dd99-ff, col_values=(('external_ids', {'iface-id': '53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:6b:88', 'vm-uuid': 'adcd9c44-c430-46ea-986d-b4f7b7888122'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:55 user nova-compute[75292]: INFO os_vif [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff')
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:52:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No VIF found with MAC fa:16:3e:2e:6b:88, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid 52818903-146d-429a-893e-3f6da6a8a17c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:56 user nova-compute[75292]: INFO nova.compute.manager [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Attaching volume 2c912d9e-4c08-40de-9a63-b6fa0115373e to /dev/vdb
Nov 14 14:52:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7904dbc-6af8-4762-9004-df282dfbeb66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[133af75b-aa92-448a-95b1-1991be7f0c5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11845ec-ff9b-4ec8-8159-66cf0e712001]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[791883e3-0a46-48a8-98df-0ae5c365c70d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:52:56 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7353303-e54a-409d-85fc-f412cc3dd929]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG os_brick.utils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updating existing volume attachment record: 2884d741-de72-45b9-8566-5b660c7e90ab {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:52:57 user nova-compute[75292]: INFO nova.compute.claims [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Claim successful on node user
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-af2b769c-5a0f-4def-ae54-0c7a6ad46268 req-153fa8be-5047-4f2a-8f82-1c56405093cd service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af2b769c-5a0f-4def-ae54-0c7a6ad46268 req-153fa8be-5047-4f2a-8f82-1c56405093cd service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af2b769c-5a0f-4def-ae54-0c7a6ad46268 req-153fa8be-5047-4f2a-8f82-1c56405093cd service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af2b769c-5a0f-4def-ae54-0c7a6ad46268 req-153fa8be-5047-4f2a-8f82-1c56405093cd service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-af2b769c-5a0f-4def-ae54-0c7a6ad46268 req-153fa8be-5047-4f2a-8f82-1c56405093cd service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:57 user nova-compute[75292]: WARNING nova.compute.manager [req-af2b769c-5a0f-4def-ae54-0c7a6ad46268 req-153fa8be-5047-4f2a-8f82-1c56405093cd service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state building and task_state spawning.
Nov 14 14:52:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.network.neutron [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:52:57 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:52:57 user nova-compute[75292]: INFO nova.virt.block_device [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Booting with volume d4550877-a389-4988-b864-d70c4508d5d3 at /dev/vda
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.policy [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12846e84377c40998d795e5f0b09252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebd367820b4847b1f8b7c402a22ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG os_brick.utils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68cec90-5591-4ceb-8cd8-2388f11130ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fa0fc8-7b63-4bf2-8dcd-90b28d054c0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42ccb7-742a-4290-9e99-0d597bd616d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d8805-50b8-46ba-9b1c-e44ff3a6ce9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:52:57 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:52:57 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bfd65c-1dd5-4f75-b845-03ae7c148ad8]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG os_brick.utils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:52:57 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updating existing volume attachment record: 77e94f00-f1aa-4c33-8f3e-e64db339699d {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Successfully created port: 8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Successfully updated port: 8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquired lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-changed-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Refreshing instance network info cache due to event network-changed-8705205c-f3e0-4a7e-8e8b-29675e4db47f. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] Acquiring lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:52:58 user nova-compute[75292]: DEBUG nova.network.neutron [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:52:59 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance spawned successfully.
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-2784c2b0-e115-4696-b652-1d96f576408a req-a13768cb-8df2-475b-9132-c8e4b56ebb5f service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2784c2b0-e115-4696-b652-1d96f576408a req-a13768cb-8df2-475b-9132-c8e4b56ebb5f service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2784c2b0-e115-4696-b652-1d96f576408a req-a13768cb-8df2-475b-9132-c8e4b56ebb5f service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2784c2b0-e115-4696-b652-1d96f576408a req-a13768cb-8df2-475b-9132-c8e4b56ebb5f service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-2784c2b0-e115-4696-b652-1d96f576408a req-a13768cb-8df2-475b-9132-c8e4b56ebb5f service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:52:59 user nova-compute[75292]: WARNING nova.compute.manager [req-2784c2b0-e115-4696-b652-1d96f576408a req-a13768cb-8df2-475b-9132-c8e4b56ebb5f service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state building and task_state spawning.
Nov 14 14:52:59 user nova-compute[75292]: INFO nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.network.neutron [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updating instance_info_cache with network_info: [{"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Releasing lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Instance network_info: |[{"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] Acquired lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.network.neutron [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Refreshing network info cache for port 8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:52:59 user nova-compute[75292]: INFO nova.compute.manager [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Took 15.84 seconds to build instance.
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dee5f761-ea55-47b6-9d9d-4f704bfa722f tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.941s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.network.neutron [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updated VIF entry in instance network info cache for port 8705205c-f3e0-4a7e-8e8b-29675e4db47f. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG nova.network.neutron [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updating instance_info_cache with network_info: [{"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d69c12f1-a514-40f0-a9e0-f9aff1bb3a17 req-707dd364-d12b-488f-847b-b2c0951d5b69 service nova] Releasing lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:52:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SElOGcJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:53:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:53:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:53:01 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20e2a5a-5b0b-4f90-bffc-986a1c082f1f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:53:01 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8689ecf9-c824-40b8-9429-1b876cabda92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e] added
Nov 14 14:53:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.081s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea978f-426f-4271-b96e-ea77290dee02]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35df37b-1722-42e5-adf3-d68eb88d47ad]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SElOGcJw {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SElOGcJw" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087f4a5-d445-4b60-b13f-2fa4bfd31b2c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SElOGcJw'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27549cd-018f-4b19-bd5e-e16d8d26493f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90de712-6ef3-42a6-9350-5feaa9338d27]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a8da5-7089-489d-a9ba-0a8256363e13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260]
Nov 14 14:53:01 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260] successful.
Nov 14 14:53:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5278ca4-190f-4e5d-845f-46c837342aa2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccca9f7-531a-4908-b127-9f3f5a4c5d5f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:53:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:01 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:53:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b66f3a-6415-409d-9070-3cc30c9e272b]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SElOGcJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:53:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:53:02 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Creating image(s)
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Ensure instance console log exists: /opt/stack/data/nova/instances/b66c8072-5bdd-4f9d-8828-a691fe539d23/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Start _get_guest_xml network_info=[{"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77e94f00-f1aa-4c33-8f3e-e64db339699d', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzHiTxBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b66c8072-5bdd-4f9d-8828-a691fe539d23', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4550877-a389-4988-b864-d70c4508d5d3', 'serial': 'd4550877-a389-4988-b864-d70c4508d5d3'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:53:02 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:02 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzHiTxBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:53:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26634653238363335', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634653238363335', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.081s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:53:02 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:53:02 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid 52818903-146d-429a-893e-3f6da6a8a17c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14528324-d7d5-4117-b162-c6269f6afcbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:53:02 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:53:02 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:53:02 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:53:02 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:53:02 user nova-compute[75292]:   <serial>2c912d9e-4c08-40de-9a63-b6fa0115373e</serial>
Nov 14 14:53:02 user nova-compute[75292]: </disk>
Nov 14 14:53:02 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8246b7-2b72-462d-b9a6-e35df679b1d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3] added
Nov 14 14:53:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6ec48c-700c-44cd-898e-55c742876733]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09a5ae-c385-447e-9232-f36440b73d36]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzHiTxBn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzHiTxBn" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89575569-af97-4f9b-8141-e14c0d84507f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzHiTxBn'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ac5e9-0ae4-4adf-8a1e-66dd09ad54ed]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8f14fb-3d62-4a8f-a706-ede07b6bb3fe]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:53:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:53:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[16060c25-3956-4d77-91ae-ef1f887dea5a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260]
Nov 14 14:53:02 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260] successful.
Nov 14 14:53:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[295ccd45-0340-4de9-8dd4-d29c32fc458d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[919e5b75-f4bb-449b-93d1-9eb74232087d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:53:02 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:53:02 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85774ac-023f-4263-a537-e570400982ea]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:53:02 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:53:03 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzHiTxBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:53:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:53:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:53:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:6e:30:23, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:53:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ca839fa1-c968-442f-807a-1be5930e73d3 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.777s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26532663765333530', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532663765333530', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1747411629',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1747411629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1747411629',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC145AzLQhOAMxkylITGjNaXYPqICo6hA3jejvF4Lt+kLSUOYUJMJmaNQPIeQ8xtZRcICPmC00kvpa8+YYTQlsiY+1+0ycPRzlt5EfyIML9vYMP3QnTWmHmKGVyO84Vxrw==',key_name='tempest-keypair-372527537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-zuchoaw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12846e84377c40998d795e5f0b09252f',uuid=b66c8072-5bdd-4f9d-8828-a691fe539d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'pci_devices' on Instance uuid b66c8072-5bdd-4f9d-8828-a691fe539d23 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:53:04 user nova-compute[75292]:   <uuid>b66c8072-5bdd-4f9d-8828-a691fe539d23</uuid>
Nov 14 14:53:04 user nova-compute[75292]:   <name>instance-00000025</name>
Nov 14 14:53:04 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:53:04 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:53:04 user nova-compute[75292]:   <metadata>
Nov 14 14:53:04 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:53:04 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:53:04 user nova-compute[75292]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1747411629</nova:name>
Nov 14 14:53:04 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:53:02</nova:creationTime>
Nov 14 14:53:04 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:53:04 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:53:04 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:53:04 user nova-compute[75292]:       <nova:owner>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:user uuid="12846e84377c40998d795e5f0b09252f">tempest-TestVolumeBootPattern-53606599-project-member</nova:user>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:project uuid="6cebd367820b4847b1f8b7c402a22ffc">tempest-TestVolumeBootPattern-53606599</nova:project>
Nov 14 14:53:04 user nova-compute[75292]:       </nova:owner>
Nov 14 14:53:04 user nova-compute[75292]:       <nova:ports>
Nov 14 14:53:04 user nova-compute[75292]:         <nova:port uuid="8705205c-f3e0-4a7e-8e8b-29675e4db47f">
Nov 14 14:53:04 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 14:53:04 user nova-compute[75292]:         </nova:port>
Nov 14 14:53:04 user nova-compute[75292]:       </nova:ports>
Nov 14 14:53:04 user nova-compute[75292]:     </nova:instance>
Nov 14 14:53:04 user nova-compute[75292]:   </metadata>
Nov 14 14:53:04 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:53:04 user nova-compute[75292]:     <system>
Nov 14 14:53:04 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:53:04 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:53:04 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:53:04 user nova-compute[75292]:       <entry name="serial">b66c8072-5bdd-4f9d-8828-a691fe539d23</entry>
Nov 14 14:53:04 user nova-compute[75292]:       <entry name="uuid">b66c8072-5bdd-4f9d-8828-a691fe539d23</entry>
Nov 14 14:53:04 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:53:04 user nova-compute[75292]:     </system>
Nov 14 14:53:04 user nova-compute[75292]:   </sysinfo>
Nov 14 14:53:04 user nova-compute[75292]:   <os>
Nov 14 14:53:04 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:53:04 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:53:04 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:53:04 user nova-compute[75292]:   </os>
Nov 14 14:53:04 user nova-compute[75292]:   <features>
Nov 14 14:53:04 user nova-compute[75292]:     <acpi/>
Nov 14 14:53:04 user nova-compute[75292]:     <apic/>
Nov 14 14:53:04 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:53:04 user nova-compute[75292]:   </features>
Nov 14 14:53:04 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:53:04 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:53:04 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:53:04 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:53:04 user nova-compute[75292]:   </clock>
Nov 14 14:53:04 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:53:04 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:53:04 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:53:04 user nova-compute[75292]:   </cpu>
Nov 14 14:53:04 user nova-compute[75292]:   <devices>
Nov 14 14:53:04 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:53:04 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:53:04 user nova-compute[75292]:       <source dev="/dev/sde"/>
Nov 14 14:53:04 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:53:04 user nova-compute[75292]:       <serial>d4550877-a389-4988-b864-d70c4508d5d3</serial>
Nov 14 14:53:04 user nova-compute[75292]:     </disk>
Nov 14 14:53:04 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:53:04 user nova-compute[75292]:       <mac address="fa:16:3e:28:5c:32"/>
Nov 14 14:53:04 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:53:04 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:53:04 user nova-compute[75292]:       <target dev="tap8705205c-f3"/>
Nov 14 14:53:04 user nova-compute[75292]:     </interface>
Nov 14 14:53:04 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:53:04 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/b66c8072-5bdd-4f9d-8828-a691fe539d23/console.log" append="off"/>
Nov 14 14:53:04 user nova-compute[75292]:     </serial>
Nov 14 14:53:04 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:53:04 user nova-compute[75292]:     <video>
Nov 14 14:53:04 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:53:04 user nova-compute[75292]:     </video>
Nov 14 14:53:04 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:53:04 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:53:04 user nova-compute[75292]:     </rng>
Nov 14 14:53:04 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:53:04 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:53:04 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:53:04 user nova-compute[75292]:     </memballoon>
Nov 14 14:53:04 user nova-compute[75292]:   </devices>
Nov 14 14:53:04 user nova-compute[75292]: </domain>
Nov 14 14:53:04 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1747411629',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1747411629',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1747411629',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC145AzLQhOAMxkylITGjNaXYPqICo6hA3jejvF4Lt+kLSUOYUJMJmaNQPIeQ8xtZRcICPmC00kvpa8+YYTQlsiY+1+0ycPRzlt5EfyIML9vYMP3QnTWmHmKGVyO84Vxrw==',key_name='tempest-keypair-372527537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-zuchoaw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12846e84377c40998d795e5f0b09252f',uuid=b66c8072-5bdd-4f9d-8828-a691fe539d23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG os_vif [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebe8010c-9c49-5ac6-ae49-d37d37b5d0db', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8705205c-f3, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8705205c-f3, col_values=(('qos', UUID('7982fef2-cb16-42a8-8d3d-f2bcc85ebf0a')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8705205c-f3, col_values=(('external_ids', {'iface-id': '8705205c-f3e0-4a7e-8e8b-29675e4db47f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:5c:32', 'vm-uuid': 'b66c8072-5bdd-4f9d-8828-a691fe539d23'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:04 user nova-compute[75292]: INFO os_vif [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3')
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No VIF found with MAC fa:16:3e:28:5c:32, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:53:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-29de31bc-11bd-47b2-8ba4-3a6ca9ad44cf req-62069cd0-2a6b-4dcf-9889-34fe15afe655 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-29de31bc-11bd-47b2-8ba4-3a6ca9ad44cf req-62069cd0-2a6b-4dcf-9889-34fe15afe655 service nova] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-29de31bc-11bd-47b2-8ba4-3a6ca9ad44cf req-62069cd0-2a6b-4dcf-9889-34fe15afe655 service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-29de31bc-11bd-47b2-8ba4-3a6ca9ad44cf req-62069cd0-2a6b-4dcf-9889-34fe15afe655 service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-29de31bc-11bd-47b2-8ba4-3a6ca9ad44cf req-62069cd0-2a6b-4dcf-9889-34fe15afe655 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] No waiting events found dispatching network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:53:05 user nova-compute[75292]: WARNING nova.compute.manager [req-29de31bc-11bd-47b2-8ba4-3a6ca9ad44cf req-62069cd0-2a6b-4dcf-9889-34fe15afe655 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received unexpected event network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f for instance with vm_state building and task_state spawning.
Nov 14 14:53:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:53:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Instance spawned successfully.
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:53:07 user nova-compute[75292]: INFO nova.compute.claims [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Claim successful on node user
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-e94569a4-7e73-41ad-8223-01633598741e req-0316d860-cd2e-433d-bc77-7f9e7f91af62 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e94569a4-7e73-41ad-8223-01633598741e req-0316d860-cd2e-433d-bc77-7f9e7f91af62 service nova] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e94569a4-7e73-41ad-8223-01633598741e req-0316d860-cd2e-433d-bc77-7f9e7f91af62 service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e94569a4-7e73-41ad-8223-01633598741e req-0316d860-cd2e-433d-bc77-7f9e7f91af62 service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-e94569a4-7e73-41ad-8223-01633598741e req-0316d860-cd2e-433d-bc77-7f9e7f91af62 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] No waiting events found dispatching network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:53:07 user nova-compute[75292]: WARNING nova.compute.manager [req-e94569a4-7e73-41ad-8223-01633598741e req-0316d860-cd2e-433d-bc77-7f9e7f91af62 service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received unexpected event network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f for instance with vm_state building and task_state spawning.
Nov 14 14:53:07 user nova-compute[75292]: INFO nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 14 14:53:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:53:07 user nova-compute[75292]: INFO nova.compute.manager [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Took 10.90 seconds to build instance.
Nov 14 14:53:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-23a725cd-a730-49b5-bb9f-b7ebc0f814d6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.998s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:53:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.policy [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3a7efbb426e4b558031f14a751e102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1d477a1d84afeb07533cddfe992d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:53:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Creating image(s)
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "/opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.255s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk 1073741824" returned: 0 in 0.054s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Cannot resize image /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Ensure instance console log exists: /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Successfully created port: 4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:53:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Successfully updated port: 4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquired lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-changed-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Refreshing instance network info cache due to event network-changed-4b040e32-004c-4884-b186-37aabbebaee8. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] Acquiring lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.neutron [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Updating instance_info_cache with network_info: [{"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Releasing lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Instance network_info: |[{"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] Acquired lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Refreshing network info cache for port 4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Start _get_guest_xml network_info=[{"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:53:11 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:11 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-383010013',display_name='tempest-AttachVolumeNegativeTest-server-383010013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-383010013',id=38,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYjXdQLk3gbh9hO2BWgbSJoDKl9doVHkDZPQ2Ey/eloBo8NRpQP9SBtwByoCMpC68mzyyKLcGMrZPqM2NBwpxY/qbsevSXwZSNd144dh0aGNgXTcrls2OG/IyYr3aS86Q==',key_name='tempest-keypair-55105243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-sbgp93on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=f006fb97-1e8c-4501-b976-12fba9343f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'pci_devices' on Instance uuid f006fb97-1e8c-4501-b976-12fba9343f4e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:53:11 user nova-compute[75292]:   <uuid>f006fb97-1e8c-4501-b976-12fba9343f4e</uuid>
Nov 14 14:53:11 user nova-compute[75292]:   <name>instance-00000026</name>
Nov 14 14:53:11 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:53:11 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:53:11 user nova-compute[75292]:   <metadata>
Nov 14 14:53:11 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:53:11 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:53:11 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeNegativeTest-server-383010013</nova:name>
Nov 14 14:53:11 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:53:11</nova:creationTime>
Nov 14 14:53:11 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:53:11 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:53:11 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:53:11 user nova-compute[75292]:       <nova:owner>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:user uuid="d3a7efbb426e4b558031f14a751e102b">tempest-AttachVolumeNegativeTest-547312228-project-member</nova:user>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:project uuid="8ae1d477a1d84afeb07533cddfe992d1">tempest-AttachVolumeNegativeTest-547312228</nova:project>
Nov 14 14:53:11 user nova-compute[75292]:       </nova:owner>
Nov 14 14:53:11 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:53:11 user nova-compute[75292]:       <nova:ports>
Nov 14 14:53:11 user nova-compute[75292]:         <nova:port uuid="4b040e32-004c-4884-b186-37aabbebaee8">
Nov 14 14:53:11 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 14:53:11 user nova-compute[75292]:         </nova:port>
Nov 14 14:53:11 user nova-compute[75292]:       </nova:ports>
Nov 14 14:53:11 user nova-compute[75292]:     </nova:instance>
Nov 14 14:53:11 user nova-compute[75292]:   </metadata>
Nov 14 14:53:11 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:53:11 user nova-compute[75292]:     <system>
Nov 14 14:53:11 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:53:11 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:53:11 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:53:11 user nova-compute[75292]:       <entry name="serial">f006fb97-1e8c-4501-b976-12fba9343f4e</entry>
Nov 14 14:53:11 user nova-compute[75292]:       <entry name="uuid">f006fb97-1e8c-4501-b976-12fba9343f4e</entry>
Nov 14 14:53:11 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:53:11 user nova-compute[75292]:     </system>
Nov 14 14:53:11 user nova-compute[75292]:   </sysinfo>
Nov 14 14:53:11 user nova-compute[75292]:   <os>
Nov 14 14:53:11 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:53:11 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:53:11 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:53:11 user nova-compute[75292]:   </os>
Nov 14 14:53:11 user nova-compute[75292]:   <features>
Nov 14 14:53:11 user nova-compute[75292]:     <acpi/>
Nov 14 14:53:11 user nova-compute[75292]:     <apic/>
Nov 14 14:53:11 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:53:11 user nova-compute[75292]:   </features>
Nov 14 14:53:11 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:53:11 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:53:11 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:53:11 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:53:11 user nova-compute[75292]:   </clock>
Nov 14 14:53:11 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:53:11 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:53:11 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:53:11 user nova-compute[75292]:   </cpu>
Nov 14 14:53:11 user nova-compute[75292]:   <devices>
Nov 14 14:53:11 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:53:11 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:53:11 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk"/>
Nov 14 14:53:11 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:53:11 user nova-compute[75292]:     </disk>
Nov 14 14:53:11 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:53:11 user nova-compute[75292]:       <mac address="fa:16:3e:05:6e:4f"/>
Nov 14 14:53:11 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:53:11 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:53:11 user nova-compute[75292]:       <target dev="tap4b040e32-00"/>
Nov 14 14:53:11 user nova-compute[75292]:     </interface>
Nov 14 14:53:11 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:53:11 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/console.log" append="off"/>
Nov 14 14:53:11 user nova-compute[75292]:     </serial>
Nov 14 14:53:11 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:53:11 user nova-compute[75292]:     <video>
Nov 14 14:53:11 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:53:11 user nova-compute[75292]:     </video>
Nov 14 14:53:11 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:53:11 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:53:11 user nova-compute[75292]:     </rng>
Nov 14 14:53:11 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:53:11 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:53:11 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:53:11 user nova-compute[75292]:     </memballoon>
Nov 14 14:53:11 user nova-compute[75292]:   </devices>
Nov 14 14:53:11 user nova-compute[75292]: </domain>
Nov 14 14:53:11 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-383010013',display_name='tempest-AttachVolumeNegativeTest-server-383010013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-383010013',id=38,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYjXdQLk3gbh9hO2BWgbSJoDKl9doVHkDZPQ2Ey/eloBo8NRpQP9SBtwByoCMpC68mzyyKLcGMrZPqM2NBwpxY/qbsevSXwZSNd144dh0aGNgXTcrls2OG/IyYr3aS86Q==',key_name='tempest-keypair-55105243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-sbgp93on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=f006fb97-1e8c-4501-b976-12fba9343f4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG os_vif [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ca3ca28-6a1f-5086-9090-0c0c2e182091', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b040e32-00, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b040e32-00, col_values=(('qos', UUID('64ce65d5-210d-4d49-9adf-e5e4c66b703f')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b040e32-00, col_values=(('external_ids', {'iface-id': '4b040e32-004c-4884-b186-37aabbebaee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:6e:4f', 'vm-uuid': 'f006fb97-1e8c-4501-b976-12fba9343f4e'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:12 user nova-compute[75292]: INFO os_vif [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00')
Nov 14 14:53:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:05:6e:4f, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Updated VIF entry in instance network info cache for port 4b040e32-004c-4884-b186-37aabbebaee8. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG nova.network.neutron [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Updating instance_info_cache with network_info: [{"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:53:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c59ecdc2-527a-465b-a7af-263f33036e6c req-6ba44677-5f9d-4dfd-974c-96abafbd272c service nova] Releasing lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:13 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:53:13 user nova-compute[75292]: INFO nova.compute.claims [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Claim successful on node user
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.network.neutron [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:53:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.policy [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b3312b416c74d92ae45d7edb5c08512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7526301dd346a9a6f3367417755a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:53:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Creating image(s)
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk 1073741824" returned: 0 in 0.091s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Successfully created port: 5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Cannot resize image /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Ensure instance console log exists: /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:53:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Instance spawned successfully.
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Successfully updated port: 5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.network.neutron [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:53:15 user nova-compute[75292]: INFO nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Took 7.63 seconds to spawn the instance on the hypervisor.
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 14:53:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-c9a68d83-7b0c-4a91-aeb6-b347574ecaa5 req-32e5cccb-4edc-4b9c-ab2a-55a3180f7127 service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c9a68d83-7b0c-4a91-aeb6-b347574ecaa5 req-32e5cccb-4edc-4b9c-ab2a-55a3180f7127 service nova] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c9a68d83-7b0c-4a91-aeb6-b347574ecaa5 req-32e5cccb-4edc-4b9c-ab2a-55a3180f7127 service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c9a68d83-7b0c-4a91-aeb6-b347574ecaa5 req-32e5cccb-4edc-4b9c-ab2a-55a3180f7127 service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-c9a68d83-7b0c-4a91-aeb6-b347574ecaa5 req-32e5cccb-4edc-4b9c-ab2a-55a3180f7127 service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] No waiting events found dispatching network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:53:16 user nova-compute[75292]: WARNING nova.compute.manager [req-c9a68d83-7b0c-4a91-aeb6-b347574ecaa5 req-32e5cccb-4edc-4b9c-ab2a-55a3180f7127 service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received unexpected event network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 for instance with vm_state building and task_state spawning.
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid a8a94376-8ca1-4e3d-84b5-e597543f7ce4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:53:16 user nova-compute[75292]: INFO nova.compute.manager [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Took 8.49 seconds to build instance.
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a926831f-02b0-4787-95bd-da08cc499111 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.663s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance network_info: |[{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Start _get_guest_xml network_info=[{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:53:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:16 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1491484863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1491484863',id=39,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHia5k7NRXViV0XgNAyzDXay3u7jjO0eHRVzHcAXEXTN5yukqVmfCFFlxnczgbajI4Olo3rSbn71LbM5K+TBQI2xLK6qkg1LafYuZIdb9wrUTVicAw4/7xxTMOjXLiosbA==',key_name='tempest-keypair-1738255639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-y01osgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=ed79b252-324c-461d-bd4b-bc379d1a1bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'pci_devices' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:53:16 user nova-compute[75292]:   <uuid>ed79b252-324c-461d-bd4b-bc379d1a1bb7</uuid>
Nov 14 14:53:16 user nova-compute[75292]:   <name>instance-00000027</name>
Nov 14 14:53:16 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:53:16 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:53:16 user nova-compute[75292]:   <metadata>
Nov 14 14:53:16 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:53:16 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:53:16 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1491484863</nova:name>
Nov 14 14:53:16 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:53:16</nova:creationTime>
Nov 14 14:53:16 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:53:16 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:53:16 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:53:16 user nova-compute[75292]:       <nova:owner>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:user uuid="4b3312b416c74d92ae45d7edb5c08512">tempest-AttachVolumeShelveTestJSON-2139265145-project-member</nova:user>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:project uuid="3f7526301dd346a9a6f3367417755a67">tempest-AttachVolumeShelveTestJSON-2139265145</nova:project>
Nov 14 14:53:16 user nova-compute[75292]:       </nova:owner>
Nov 14 14:53:16 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:53:16 user nova-compute[75292]:       <nova:ports>
Nov 14 14:53:16 user nova-compute[75292]:         <nova:port uuid="5962ed86-a94f-4ee3-a048-e67a38860eb0">
Nov 14 14:53:16 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 14:53:16 user nova-compute[75292]:         </nova:port>
Nov 14 14:53:16 user nova-compute[75292]:       </nova:ports>
Nov 14 14:53:16 user nova-compute[75292]:     </nova:instance>
Nov 14 14:53:16 user nova-compute[75292]:   </metadata>
Nov 14 14:53:16 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:53:16 user nova-compute[75292]:     <system>
Nov 14 14:53:16 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:53:16 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:53:16 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:53:16 user nova-compute[75292]:       <entry name="serial">ed79b252-324c-461d-bd4b-bc379d1a1bb7</entry>
Nov 14 14:53:16 user nova-compute[75292]:       <entry name="uuid">ed79b252-324c-461d-bd4b-bc379d1a1bb7</entry>
Nov 14 14:53:16 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:53:16 user nova-compute[75292]:     </system>
Nov 14 14:53:16 user nova-compute[75292]:   </sysinfo>
Nov 14 14:53:16 user nova-compute[75292]:   <os>
Nov 14 14:53:16 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:53:16 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:53:16 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:53:16 user nova-compute[75292]:   </os>
Nov 14 14:53:16 user nova-compute[75292]:   <features>
Nov 14 14:53:16 user nova-compute[75292]:     <acpi/>
Nov 14 14:53:16 user nova-compute[75292]:     <apic/>
Nov 14 14:53:16 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:53:16 user nova-compute[75292]:   </features>
Nov 14 14:53:16 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:53:16 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:53:16 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:53:16 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:53:16 user nova-compute[75292]:   </clock>
Nov 14 14:53:16 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:53:16 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:53:16 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:53:16 user nova-compute[75292]:   </cpu>
Nov 14 14:53:16 user nova-compute[75292]:   <devices>
Nov 14 14:53:16 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:53:16 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:53:16 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk"/>
Nov 14 14:53:16 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:53:16 user nova-compute[75292]:     </disk>
Nov 14 14:53:16 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:53:16 user nova-compute[75292]:       <mac address="fa:16:3e:5f:9f:00"/>
Nov 14 14:53:16 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:53:16 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:53:16 user nova-compute[75292]:       <target dev="tap5962ed86-a9"/>
Nov 14 14:53:16 user nova-compute[75292]:     </interface>
Nov 14 14:53:16 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:53:16 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/console.log" append="off"/>
Nov 14 14:53:16 user nova-compute[75292]:     </serial>
Nov 14 14:53:16 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:53:16 user nova-compute[75292]:     <video>
Nov 14 14:53:16 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:53:16 user nova-compute[75292]:     </video>
Nov 14 14:53:16 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:53:16 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:53:16 user nova-compute[75292]:     </rng>
Nov 14 14:53:16 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:53:16 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:53:16 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:53:16 user nova-compute[75292]:     </memballoon>
Nov 14 14:53:16 user nova-compute[75292]:   </devices>
Nov 14 14:53:16 user nova-compute[75292]: </domain>
Nov 14 14:53:16 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1491484863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1491484863',id=39,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHia5k7NRXViV0XgNAyzDXay3u7jjO0eHRVzHcAXEXTN5yukqVmfCFFlxnczgbajI4Olo3rSbn71LbM5K+TBQI2xLK6qkg1LafYuZIdb9wrUTVicAw4/7xxTMOjXLiosbA==',key_name='tempest-keypair-1738255639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-y01osgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=ed79b252-324c-461d-bd4b-bc379d1a1bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG os_vif [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5df3b717-7663-5e18-b9e7-023aa7a59a56', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5962ed86-a9, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5962ed86-a9, col_values=(('qos', UUID('287d7215-abf1-4c82-bdf9-9d7f6478a94d')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5962ed86-a9, col_values=(('external_ids', {'iface-id': '5962ed86-a94f-4ee3-a048-e67a38860eb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9f:00', 'vm-uuid': 'ed79b252-324c-461d-bd4b-bc379d1a1bb7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:16 user nova-compute[75292]: INFO os_vif [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9')
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updating instance_info_cache with network_info: [{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:53:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No VIF found with MAC fa:16:3e:5f:9f:00, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:53:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing instance network info cache due to event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-0d98954e-ceb1-4ffd-9240-22c4af10c1fb req-d727f17e-8565-4c8f-b40d-5349b1fce1d8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0d98954e-ceb1-4ffd-9240-22c4af10c1fb req-d727f17e-8565-4c8f-b40d-5349b1fce1d8 service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0d98954e-ceb1-4ffd-9240-22c4af10c1fb req-d727f17e-8565-4c8f-b40d-5349b1fce1d8 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0d98954e-ceb1-4ffd-9240-22c4af10c1fb req-d727f17e-8565-4c8f-b40d-5349b1fce1d8 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-0d98954e-ceb1-4ffd-9240-22c4af10c1fb req-d727f17e-8565-4c8f-b40d-5349b1fce1d8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:53:18 user nova-compute[75292]: WARNING nova.compute.manager [req-0d98954e-ceb1-4ffd-9240-22c4af10c1fb req-d727f17e-8565-4c8f-b40d-5349b1fce1d8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state building and task_state spawning.
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updated VIF entry in instance network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] No waiting events found dispatching network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:53:18 user nova-compute[75292]: WARNING nova.compute.manager [req-fa457439-6e8b-4962-9a4f-d0161511fc45 req-f72d8ae5-4e45-44b9-a2f6-feedf56faeba service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received unexpected event network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 for instance with vm_state active and task_state None.
Nov 14 14:53:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3b5a364-1735-4735-aad2-4773354d0141 req-f7e3281c-add4-4237-a000-53bca40f071b service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3b5a364-1735-4735-aad2-4773354d0141 req-f7e3281c-add4-4237-a000-53bca40f071b service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3b5a364-1735-4735-aad2-4773354d0141 req-f7e3281c-add4-4237-a000-53bca40f071b service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a3b5a364-1735-4735-aad2-4773354d0141 req-f7e3281c-add4-4237-a000-53bca40f071b service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-a3b5a364-1735-4735-aad2-4773354d0141 req-f7e3281c-add4-4237-a000-53bca40f071b service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:53:20 user nova-compute[75292]: WARNING nova.compute.manager [req-a3b5a364-1735-4735-aad2-4773354d0141 req-f7e3281c-add4-4237-a000-53bca40f071b service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state building and task_state spawning.
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:53:20 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance spawned successfully.
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:53:20 user nova-compute[75292]: INFO nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 14 14:53:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:53:20 user nova-compute[75292]: INFO nova.compute.manager [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Took 6.65 seconds to build instance.
Nov 14 14:53:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-905e2a75-23c1-4584-8676-71a589453312 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.751s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:21 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:22 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:53:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:53:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:25 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:25 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7986MB free_disk=25.210552215576172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 52818903-146d-429a-893e-3f6da6a8a17c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance adcd9c44-c430-46ea-986d-b4f7b7888122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b66c8072-5bdd-4f9d-8828-a691fe539d23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f006fb97-1e8c-4501-b976-12fba9343f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:53:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:53:26 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:53:26 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:53:26 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:53:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.880s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:53:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:53:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:53:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:53:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-changed-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Refreshing instance network info cache due to event network-changed-34b97837-d647-4ae4-90dc-771f16198958. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] Acquiring lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] Acquired lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG nova.network.neutron [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Refreshing network info cache for port 34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'flavor' on Instance uuid 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Ignoring supplied device name: /dev/vdb
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:01 user nova-compute[75292]: INFO nova.compute.manager [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Attaching volume ac584290-8c02-4111-9fa0-f8ed31124f42 to /dev/vdb
Nov 14 14:54:02 user nova-compute[75292]: DEBUG os_brick.utils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf24a0ae-dc78-48a1-8428-f0ac058d96f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updated VIF entry in instance network info cache for port 34b97837-d647-4ae4-90dc-771f16198958. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG nova.network.neutron [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updating instance_info_cache with network_info: [{"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffde73bb-3b33-4cde-8616-c14c1f6e8517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e23a40db-b4ce-44da-9b04-829ea38f4e3a req-72e3cbd4-51e5-4c92-b702-8198ab08d2db service nova] Releasing lock "refresh_cache-0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0216d130-6291-455b-9456-a99a5031c396]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[46853ccf-7c5f-4b02-a650-5cb361d87501]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:54:02 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:54:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[67154b1c-0c7c-48c5-bae2-924b47c45e53]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG os_brick.utils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:54:02 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updating existing volume attachment record: 5bea33ab-d4b5-42ec-bc72-687177c922d3 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:54:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQspVGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:54:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:54:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:54:06 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[625d36ba-cfa3-476f-b8f9-96945db01b4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:54:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1206d-14d6-4795-9847-4aff416d3449]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42] added
Nov 14 14:54:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6d9267-6783-496c-b4bd-09ad84f3ba95]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f22bf9-d115-460e-8d56-7cd5f2fa4e0b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbQspVGj {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbQspVGj" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43f8306-3773-42b5-8b4a-19b3fbaeb843]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbQspVGj'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd1e2a-833e-4234-a752-9134c1a5d3ff]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d93395-5dcb-441f-969e-578cf3666fac]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a5b987-61c4-478f-8f6e-d4f71011dd3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260]
Nov 14 14:54:06 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260] successful.
Nov 14 14:54:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b647ea-baf2-4ea1-a29c-1b1fa9c84215]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b6a075-a14f-4168-b1de-d8e2583bbb3f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 (non-flash)
Nov 14 14:54:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1465bc-2697-41f8-8fdc-bdc49080489d]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:54:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQspVGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:54:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:54:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26339316136656462', 'path': '/dev/sdf'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:54:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339316136656462', 'path': '/dev/sdf'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:54:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'flavor' on Instance uuid 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:54:07 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:54:07 user nova-compute[75292]:   <source dev="/dev/sdf"/>
Nov 14 14:54:07 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:54:07 user nova-compute[75292]:   <serial>ac584290-8c02-4111-9fa0-f8ed31124f42</serial>
Nov 14 14:54:07 user nova-compute[75292]: </disk>
Nov 14 14:54:07 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:54:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:54:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:54:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] No VIF found with MAC fa:16:3e:4c:89:74, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:54:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d11dcf99-7cc0-4085-a571-2a864a70cb3d tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.275s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:14 user nova-compute[75292]: INFO nova.compute.manager [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Detaching volume ac584290-8c02-4111-9fa0-f8ed31124f42
Nov 14 14:54:14 user nova-compute[75292]: INFO nova.virt.block_device [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Attempting to driver detach volume ac584290-8c02-4111-9fa0-f8ed31124f42 from mountpoint /dev/vdb
Nov 14 14:54:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Attempting to detach device vdb from instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:54:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:54:14 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:54:14 user nova-compute[75292]:   <source dev="/dev/sdf"/>
Nov 14 14:54:14 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:54:14 user nova-compute[75292]:   <serial>ac584290-8c02-4111-9fa0-f8ed31124f42</serial>
Nov 14 14:54:14 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:54:14 user nova-compute[75292]: </disk>
Nov 14 14:54:14 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:54:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully detached device vdb from instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 from the persistent domain config.
Nov 14 14:54:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:54:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:54:14 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:54:14 user nova-compute[75292]:   <source dev="/dev/sdf"/>
Nov 14 14:54:14 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:54:14 user nova-compute[75292]:   <serial>ac584290-8c02-4111-9fa0-f8ed31124f42</serial>
Nov 14 14:54:14 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:54:14 user nova-compute[75292]: </disk>
Nov 14 14:54:14 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:54:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:54:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [{"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-5399567a-14b0-42ce-9fe0-b0fb74249b85" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:23 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:54:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:26 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:54:26 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:54:26 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=7942MB free_disk=25.145706176757812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 52818903-146d-429a-893e-3f6da6a8a17c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance adcd9c44-c430-46ea-986d-b4f7b7888122 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b66c8072-5bdd-4f9d-8828-a691fe539d23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f006fb97-1e8c-4501-b976-12fba9343f4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.667s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 14:54:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:54:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 14:54:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 14:54:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:54:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:54:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:54:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:54:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:34 user nova-compute[75292]: INFO nova.compute.manager [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Rescuing
Nov 14 14:54:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:54:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating instance_info_cache with network_info: [{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:34 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 is timed out.
Nov 14 14:54:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully detached device vdb from instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 from the live domain config.
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQspVGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:54:35 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aec8c4-13b2-4aed-b82c-43a9dbbc8f08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:54:35 user nova-compute[75292]: No targets found.
Nov 14 14:54:35 user nova-compute[75292]: iSNS:
Nov 14 14:54:35 user nova-compute[75292]: No targets found.
Nov 14 14:54:35 user nova-compute[75292]: STATIC:
Nov 14 14:54:35 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:54:35 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:35 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:35 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3
Nov 14 14:54:35 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:35 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:35 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e
Nov 14 14:54:35 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:35 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:35 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42
Nov 14 14:54:35 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:35 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:35 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:54:35 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:35 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:35 user nova-compute[75292]: FIRMWARE:
Nov 14 14:54:35 user nova-compute[75292]: No targets found.
Nov 14 14:54:35 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:54:35 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:54:35 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b136c4b-b815-45cf-b4dc-dd53edc0a775]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b73865f-911c-4633-a0dd-fd6f38aa1e5e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 (non-flash)
Nov 14 14:54:35 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b30709c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42'): ({'sdf'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Removing single pathed devices sdf {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12c3573-65c3-4821-ae10-ae0d1338d2ce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[071afe23-ff53-44de-ae4c-3054aabe7abd]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Flushing IO for device /dev/sdf {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf2696c-150c-4fe3-91c6-a1cd16d8d7c2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-48b8ee78-b6ed-446a-b6a4-84887f74fa4a req-da2a3c9d-2715-4044-9a53-dfefb1f9fe41 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-48b8ee78-b6ed-446a-b6a4-84887f74fa4a req-da2a3c9d-2715-4044-9a53-dfefb1f9fe41 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-48b8ee78-b6ed-446a-b6a4-84887f74fa4a req-da2a3c9d-2715-4044-9a53-dfefb1f9fe41 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-48b8ee78-b6ed-446a-b6a4-84887f74fa4a req-da2a3c9d-2715-4044-9a53-dfefb1f9fe41 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-48b8ee78-b6ed-446a-b6a4-84887f74fa4a req-da2a3c9d-2715-4044-9a53-dfefb1f9fe41 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:35 user nova-compute[75292]: WARNING nova.compute.manager [req-48b8ee78-b6ed-446a-b6a4-84887f74fa4a req-da2a3c9d-2715-4044-9a53-dfefb1f9fe41 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state active and task_state rescuing.
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60235f09-92c2-4fb2-a01d-33745cd67179]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a3d4d-6562-4e2d-b516-6754c3023c2f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a5429-41a7-43b3-bd11-0061e7eeed54]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260]
Nov 14 14:54:35 user nova-compute[75292]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42, portal: 172.16.0.220,3260] successful.
Nov 14 14:54:35 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d8fce2-4551-4150-ac50-2cc8e170e563]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== disconnect_volume: return (380ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:54:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance destroyed successfully.
Nov 14 14:54:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Attempting a stable device rescue
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75292) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance directory exists: not creating {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 14:54:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Creating image(s)
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "/opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "/opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'trusted_certs' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "8e710a7351941b0d49ebb099f1f141b0f1b75ffd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "8e710a7351941b0d49ebb099f1f141b0f1b75ffd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG nova.objects.instance [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'flavor' on Instance uuid 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-68777618-7e3e-431d-8cd0-88a8ff0bb546 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.892s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:36 user nova-compute[75292]: INFO nova.compute.manager [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Terminating instance
Nov 14 14:54:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG nova.virt.images [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] f1c944c6-c587-4100-b785-95566eb73bab was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.part /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.part /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.converted" returned: 0 in 0.426s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-49ef10bd-75cc-4f12-8c87-fb53c4c691de req-40dd7095-41a5-44fe-810a-aa8d30bc5cb8 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-vif-unplugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49ef10bd-75cc-4f12-8c87-fb53c4c691de req-40dd7095-41a5-44fe-810a-aa8d30bc5cb8 service nova] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49ef10bd-75cc-4f12-8c87-fb53c4c691de req-40dd7095-41a5-44fe-810a-aa8d30bc5cb8 service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49ef10bd-75cc-4f12-8c87-fb53c4c691de req-40dd7095-41a5-44fe-810a-aa8d30bc5cb8 service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-49ef10bd-75cc-4f12-8c87-fb53c4c691de req-40dd7095-41a5-44fe-810a-aa8d30bc5cb8 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] No waiting events found dispatching network-vif-unplugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-49ef10bd-75cc-4f12-8c87-fb53c4c691de req-40dd7095-41a5-44fe-810a-aa8d30bc5cb8 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-vif-unplugged-34b97837-d647-4ae4-90dc-771f16198958 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "8e710a7351941b0d49ebb099f1f141b0f1b75ffd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.707s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "8e710a7351941b0d49ebb099f1f141b0f1b75ffd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "8e710a7351941b0d49ebb099f1f141b0f1b75ffd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-427357bb-6c5d-4e73-8eb5-7efdb850b0f0 req-d1ae7cbb-b071-4bbf-a6bb-bfc97ca6b5cb service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-427357bb-6c5d-4e73-8eb5-7efdb850b0f0 req-d1ae7cbb-b071-4bbf-a6bb-bfc97ca6b5cb service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-427357bb-6c5d-4e73-8eb5-7efdb850b0f0 req-d1ae7cbb-b071-4bbf-a6bb-bfc97ca6b5cb service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-427357bb-6c5d-4e73-8eb5-7efdb850b0f0 req-d1ae7cbb-b071-4bbf-a6bb-bfc97ca6b5cb service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-427357bb-6c5d-4e73-8eb5-7efdb850b0f0 req-d1ae7cbb-b071-4bbf-a6bb-bfc97ca6b5cb service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:37 user nova-compute[75292]: WARNING nova.compute.manager [req-427357bb-6c5d-4e73-8eb5-7efdb850b0f0 req-d1ae7cbb-b071-4bbf-a6bb-bfc97ca6b5cb service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state active and task_state rescuing.
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd,backing_fmt=raw /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd,backing_fmt=raw /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue" returned: 0 in 0.066s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "8e710a7351941b0d49ebb099f1f141b0f1b75ffd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'migration_context' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Instance destroyed successfully.
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lazy-loading 'resources' on Instance uuid 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<adcd9c44-c430-46ea-986d-b4f7b7888122> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Start _get_guest_xml network_info=[{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "vif_mac": "fa:16:3e:2e:6b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f1c944c6-c587-4100-b785-95566eb73bab', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77b86d5c-fee7-449f-b370-9f7446e51d94', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'adcd9c44-c430-46ea-986d-b4f7b7888122', 'attached_at': '', 'detached_at': '', 'volume_id': '78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'serial': '78c8c620-e8b2-4f4e-b93b-582a8bd791a9'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'resources' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1804736052',display_name='tempest-VolumesSnapshotTestJSON-instance-1804736052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1804736052',id=35,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgthYssI0hDrbcvzCNh+69HwFPBdncnp4YU+q94Y+PKImbn+iEBbd3CA9s4eax8Mp70um9L+76YO97TB53w68Ti5o616JUm7Y73DyL+k94hlwLojYiaT8y9jBnOCK9O8A==',key_name='tempest-keypair-1735419335',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:52:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f986a9cc69146d58b322282d38eb722',ramdisk_id='',reservation_id='r-g96hseqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-641028471',owner_user_name='tempest-VolumesSnapshotTestJSON-641028471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1d2a969f8d924908b94319b09da16949',uuid=0a0d84e0-be0b-497e-ba06-b71db5cdc5d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converting VIF {"id": "34b97837-d647-4ae4-90dc-771f16198958", "address": "fa:16:3e:4c:89:74", "network": {"id": "1006e196-fafc-4927-b39d-6e64687a90b6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1172136566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f986a9cc69146d58b322282d38eb722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34b97837-d6", "ovs_interfaceid": "34b97837-d647-4ae4-90dc-771f16198958", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_vif [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<adcd9c44-c430-46ea-986d-b4f7b7888122> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'numa_topology' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34b97837-d6, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<adcd9c44-c430-46ea-986d-b4f7b7888122> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:54:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:54:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5efd183f-4ce6-4bcb-8424-2a75a2b21262) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'vcpu_model' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:37 user nova-compute[75292]: INFO os_vif [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:89:74,bridge_name='br-int',has_traffic_filtering=True,id=34b97837-d647-4ae4-90dc-771f16198958,network=Network(1006e196-fafc-4927-b39d-6e64687a90b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34b97837-d6')
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQspVGj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:54:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<adcd9c44-c430-46ea-986d-b4f7b7888122> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:54:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[19894e25-223f-4885-a4f2-a99069a096f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:54:37 user nova-compute[75292]: No targets found.
Nov 14 14:54:37 user nova-compute[75292]: iSNS:
Nov 14 14:54:37 user nova-compute[75292]: No targets found.
Nov 14 14:54:37 user nova-compute[75292]: STATIC:
Nov 14 14:54:37 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:54:37 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:37 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:37 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3
Nov 14 14:54:37 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:37 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:37 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e
Nov 14 14:54:37 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:37 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:37 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:54:37 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:54:37 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:54:37 user nova-compute[75292]: FIRMWARE:
Nov 14 14:54:37 user nova-compute[75292]: No targets found.
Nov 14 14:54:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:54:37 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:54:37 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac584290-8c02-4111-9fa0-f8ed31124f42', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fd4e9a-11ef-4812-a958-716a0b953f61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca6c23-7701-4800-9d75-ace1fd3d7fb2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b742057e0>, {}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Disconnecting from: [] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] <== disconnect_volume: return (85ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:54:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Deleting instance files /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4_del
Nov 14 14:54:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Deletion of /opt/stack/data/nova/instances/0a0d84e0-be0b-497e-ba06-b71db5cdc5d4_del complete
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.061s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:54:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:54:37 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76ff344-80f7-4a32-af19-55104a7e4b4c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = sKANaJlz\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 14:54:37 user nova-compute[75292]: node.name = iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:54:37 user nova-compute[75292]: node.tpgt = -1
Nov 14 14:54:37 user nova-compute[75292]: node.startup = automatic
Nov 14 14:54:37 user nova-compute[75292]: node.leading_login = No
Nov 14 14:54:37 user nova-compute[75292]: iface.iscsi_ifacename = default
Nov 14 14:54:37 user nova-compute[75292]: iface.net_ifacename = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.ipaddress = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.prefix_len = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.hwaddress = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.transport_name = tcp
Nov 14 14:54:37 user nova-compute[75292]: iface.initiatorname = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.vlan_id = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.vlan_priority = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.vlan_state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.iface_num = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.mtu = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.port = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.bootproto = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.subnet_mask = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.gateway = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_alt_client_id = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_dns = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_learn_iqn = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_vendor_id_state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_vendor_id = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.dhcp_slp_da = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.fragmentation = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.gratuitous_arp = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.incoming_forwarding = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.tos_state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.tos = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.ttl = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.delayed_ack = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.tcp_nagle = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.tcp_wsf_state = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.tcp_wsf = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.tcp_timer_scale = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.tcp_timestamp = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.redirect = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.def_task_mgmt_timeout = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.header_digest = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.data_digest = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.immediate_data = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.initial_r2t = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.data_seq_inorder = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.data_pdu_inorder = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.erl = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.max_receive_data_len = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.first_burst_len = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.max_outstanding_r2t = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.max_burst_len = 0
Nov 14 14:54:37 user nova-compute[75292]: iface.chap_auth = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.bidi_chap = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.strict_login_compliance = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.discovery_auth = <empty>
Nov 14 14:54:37 user nova-compute[75292]: iface.discovery_logout = <empty>
Nov 14 14:54:37 user nova-compute[75292]: node.discovery_address = <empty>
Nov 14 14:54:37 user nova-compute[75292]: node.discovery_port = 0
Nov 14 14:54:37 user nova-compute[75292]: node.discovery_type = static
Nov 14 14:54:37 user nova-compute[75292]: node.session.initial_cmdsn = 0
Nov 14 14:54:37 user nova-compute[75292]: node.session.initial_login_retry_max = 8
Nov 14 14:54:37 user nova-compute[75292]: node.session.xmit_thread_priority = -20
Nov 14 14:54:37 user nova-compute[75292]: node.session.cmds_max = 128
Nov 14 14:54:37 user nova-compute[75292]: node.session.queue_depth = 32
Nov 14 14:54:37 user nova-compute[75292]: node.session.nr_sessions = 1
Nov 14 14:54:37 user nova-compute[75292]: node.session.auth.authmethod = CHAP
Nov 14 14:54:37 user nova-compute[75292]: node.session.auth.username = sKANaJlz
Nov 14 14:54:37 user nova-compute[75292]: node.session.auth.password = ***
Nov 14 14:54:37 user nova-compute[75292]: node.session.auth.username_in = <empty>
Nov 14 14:54:37 user nova-compute[75292]: node.session.auth.password_in = <empty>
Nov 14 14:54:37 user nova-compute[75292]: node.session.auth.chap_algs = MD5
Nov 14 14:54:37 user nova-compute[75292]: node.session.timeo.replacement_timeout = 120
Nov 14 14:54:37 user nova-compute[75292]: node.session.err_timeo.abort_timeout = 15
Nov 14 14:54:37 user nova-compute[75292]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 14:54:37 user nova-compute[75292]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 14:54:37 user nova-compute[75292]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.FastAbort = Yes
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.InitialR2T = No
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.ImmediateData = Yes
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.MaxConnections = 1
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 14:54:37 user nova-compute[75292]: node.session.iscsi.ERL = 0
Nov 14 14:54:37 user nova-compute[75292]: node.session.scan = manual
Nov 14 14:54:37 user nova-compute[75292]: node.session.reopen_max = 0
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].address = 172.16.0.220
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].port = 3260
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].startup = manual
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].tcp.window_size = 524288
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].tcp.type_of_service = 0
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].timeo.logout_timeout = 15
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].timeo.login_timeout = 15
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].timeo.auth_timeout = 45
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].iscsi.DataDigest = None
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].iscsi.IFMarker = No
Nov 14 14:54:37 user nova-compute[75292]: node.conn[0].iscsi.OFMarker = No
Nov 14 14:54:37 user nova-compute[75292]: # END RECORD
Nov 14 14:54:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950d55e-e926-4340-bbc4-39fe1e5bb4bc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323c7ce-5628-46b4-8e4d-2027c577ba29]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:37 user nova-compute[75292]: INFO nova.compute.manager [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKANaJlz {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sKANaJlz" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb0dfcb-20ec-4bae-a045-1a86f13b7fec]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sKANaJlz'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26cfa87-be51-47ca-9b88-50f19ef191b8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[709dd54a-3ae6-48d4-8d3f-d3dfc6f740f4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:54:37 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:54:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] HCTL ('33', '0', '0', 0) found on session 43 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b68fb-8d2d-4c5a-bce4-adb054ddb66a]: (4, ('0 0 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Searching for a device in session 43 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.171s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== connect_volume: return (232ms) {'type': 'block', 'scsi_wwn': '26362383339613833', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362383339613833', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488050270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488050270',id=36,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:52:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-gyl6gldd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:52:59Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=adcd9c44-c430-46ea-986d-b4f7b7888122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "vif_mac": "fa:16:3e:2e:6b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "vif_mac": "fa:16:3e:2e:6b:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'pci_devices' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.objects.base [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Object Instance<adcd9c44-c430-46ea-986d-b4f7b7888122> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:54:37 user nova-compute[75292]:   <uuid>adcd9c44-c430-46ea-986d-b4f7b7888122</uuid>
Nov 14 14:54:37 user nova-compute[75292]:   <name>instance-00000024</name>
Nov 14 14:54:37 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:54:37 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:54:37 user nova-compute[75292]:   <metadata>
Nov 14 14:54:37 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:54:37 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:54:37 user nova-compute[75292]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1488050270</nova:name>
Nov 14 14:54:37 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:54:37</nova:creationTime>
Nov 14 14:54:37 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:54:37 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:54:37 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:54:37 user nova-compute[75292]:       <nova:owner>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:user uuid="38a8da6883ae40c4b12c8c483d598a40">tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member</nova:user>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:project uuid="60ef654d69c34328893549c7a124aebf">tempest-ServerBootFromVolumeStableRescueTest-172724502</nova:project>
Nov 14 14:54:37 user nova-compute[75292]:       </nova:owner>
Nov 14 14:54:37 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:54:37 user nova-compute[75292]:       <nova:ports>
Nov 14 14:54:37 user nova-compute[75292]:         <nova:port uuid="53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2">
Nov 14 14:54:37 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 14:54:37 user nova-compute[75292]:         </nova:port>
Nov 14 14:54:37 user nova-compute[75292]:       </nova:ports>
Nov 14 14:54:37 user nova-compute[75292]:     </nova:instance>
Nov 14 14:54:37 user nova-compute[75292]:   </metadata>
Nov 14 14:54:37 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:54:37 user nova-compute[75292]:     <system>
Nov 14 14:54:37 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:54:37 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:54:37 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:54:37 user nova-compute[75292]:       <entry name="serial">adcd9c44-c430-46ea-986d-b4f7b7888122</entry>
Nov 14 14:54:37 user nova-compute[75292]:       <entry name="uuid">adcd9c44-c430-46ea-986d-b4f7b7888122</entry>
Nov 14 14:54:37 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:54:37 user nova-compute[75292]:     </system>
Nov 14 14:54:37 user nova-compute[75292]:   </sysinfo>
Nov 14 14:54:37 user nova-compute[75292]:   <os>
Nov 14 14:54:37 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:54:37 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:54:37 user nova-compute[75292]:   </os>
Nov 14 14:54:37 user nova-compute[75292]:   <features>
Nov 14 14:54:37 user nova-compute[75292]:     <acpi/>
Nov 14 14:54:37 user nova-compute[75292]:     <apic/>
Nov 14 14:54:37 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:54:37 user nova-compute[75292]:   </features>
Nov 14 14:54:37 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:54:37 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:54:37 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:54:37 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:54:37 user nova-compute[75292]:   </clock>
Nov 14 14:54:37 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:54:37 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:54:37 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:54:37 user nova-compute[75292]:   </cpu>
Nov 14 14:54:37 user nova-compute[75292]:   <devices>
Nov 14 14:54:37 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:54:37 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:54:37 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:54:37 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:54:37 user nova-compute[75292]:       <serial>78c8c620-e8b2-4f4e-b93b-582a8bd791a9</serial>
Nov 14 14:54:37 user nova-compute[75292]:     </disk>
Nov 14 14:54:37 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:54:37 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:54:37 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue"/>
Nov 14 14:54:37 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 14:54:37 user nova-compute[75292]:       <boot order="1"/>
Nov 14 14:54:37 user nova-compute[75292]:     </disk>
Nov 14 14:54:37 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:54:37 user nova-compute[75292]:       <mac address="fa:16:3e:2e:6b:88"/>
Nov 14 14:54:37 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:54:37 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:54:37 user nova-compute[75292]:       <target dev="tap53d5dd99-ff"/>
Nov 14 14:54:37 user nova-compute[75292]:     </interface>
Nov 14 14:54:37 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:54:37 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/console.log" append="off"/>
Nov 14 14:54:37 user nova-compute[75292]:     </serial>
Nov 14 14:54:37 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:54:37 user nova-compute[75292]:     <video>
Nov 14 14:54:37 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:54:37 user nova-compute[75292]:     </video>
Nov 14 14:54:37 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:54:37 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:54:37 user nova-compute[75292]:     </rng>
Nov 14 14:54:37 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:54:37 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:54:37 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:54:37 user nova-compute[75292]:     </memballoon>
Nov 14 14:54:37 user nova-compute[75292]:   </devices>
Nov 14 14:54:37 user nova-compute[75292]: </domain>
Nov 14 14:54:37 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:54:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance destroyed successfully.
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:54:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] No VIF found with MAC fa:16:3e:2e:6b:88, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:54:38 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:38 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Took 0.94 seconds to deallocate network for instance.
Nov 14 14:54:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-658562a9-23af-4da8-84ba-3889625cafc7 req-34e1696f-96c5-4f33-9dee-0ff0bbebb987 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-vif-deleted-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:38 user nova-compute[75292]: WARNING nova.volume.cinder [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Attachment 5bea33ab-d4b5-42ec-bc72-687177c922d3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5bea33ab-d4b5-42ec-bc72-687177c922d3. (HTTP 404) (Request-ID: req-fc7458d6-3bb5-4e48-b5ab-01e8d4a9babc)
Nov 14 14:54:38 user nova-compute[75292]: INFO nova.compute.manager [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 14:54:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-40739b8a-572a-4076-b7c2-a1fad96729d4 req-4c2f1c08-c9b7-4c14-8fbb-a0e5731fac16 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received event network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-40739b8a-572a-4076-b7c2-a1fad96729d4 req-4c2f1c08-c9b7-4c14-8fbb-a0e5731fac16 service nova] Acquiring lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-40739b8a-572a-4076-b7c2-a1fad96729d4 req-4c2f1c08-c9b7-4c14-8fbb-a0e5731fac16 service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-40739b8a-572a-4076-b7c2-a1fad96729d4 req-4c2f1c08-c9b7-4c14-8fbb-a0e5731fac16 service nova] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-40739b8a-572a-4076-b7c2-a1fad96729d4 req-4c2f1c08-c9b7-4c14-8fbb-a0e5731fac16 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] No waiting events found dispatching network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:39 user nova-compute[75292]: WARNING nova.compute.manager [req-40739b8a-572a-4076-b7c2-a1fad96729d4 req-4c2f1c08-c9b7-4c14-8fbb-a0e5731fac16 service nova] [instance: 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4] Received unexpected event network-vif-plugged-34b97837-d647-4ae4-90dc-771f16198958 for instance with vm_state deleted and task_state None.
Nov 14 14:54:39 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Deleted allocations for instance 0a0d84e0-be0b-497e-ba06-b71db5cdc5d4
Nov 14 14:54:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-385113ec-7dc4-4a19-bea7-72919709cd84 tempest-VolumesSnapshotTestJSON-641028471 tempest-VolumesSnapshotTestJSON-641028471-project-member] Lock "0a0d84e0-be0b-497e-ba06-b71db5cdc5d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.898s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-23187ba3-7ee7-40cb-a2ed-59b38cf2a8aa req-dc1ce908-f192-4635-abf1-22694a7f1250 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-23187ba3-7ee7-40cb-a2ed-59b38cf2a8aa req-dc1ce908-f192-4635-abf1-22694a7f1250 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-23187ba3-7ee7-40cb-a2ed-59b38cf2a8aa req-dc1ce908-f192-4635-abf1-22694a7f1250 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-23187ba3-7ee7-40cb-a2ed-59b38cf2a8aa req-dc1ce908-f192-4635-abf1-22694a7f1250 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-23187ba3-7ee7-40cb-a2ed-59b38cf2a8aa req-dc1ce908-f192-4635-abf1-22694a7f1250 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:39 user nova-compute[75292]: WARNING nova.compute.manager [req-23187ba3-7ee7-40cb-a2ed-59b38cf2a8aa req-dc1ce908-f192-4635-abf1-22694a7f1250 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state active and task_state rescuing.
Nov 14 14:54:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-983f0547-fdc3-45e8-8fa8-b2e06c417187 req-eec2e80c-eb8e-40d4-bbdf-b54e3d22fe00 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-983f0547-fdc3-45e8-8fa8-b2e06c417187 req-eec2e80c-eb8e-40d4-bbdf-b54e3d22fe00 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-983f0547-fdc3-45e8-8fa8-b2e06c417187 req-eec2e80c-eb8e-40d4-bbdf-b54e3d22fe00 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-983f0547-fdc3-45e8-8fa8-b2e06c417187 req-eec2e80c-eb8e-40d4-bbdf-b54e3d22fe00 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-983f0547-fdc3-45e8-8fa8-b2e06c417187 req-eec2e80c-eb8e-40d4-bbdf-b54e3d22fe00 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:41 user nova-compute[75292]: WARNING nova.compute.manager [req-983f0547-fdc3-45e8-8fa8-b2e06c417187 req-eec2e80c-eb8e-40d4-bbdf-b54e3d22fe00 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state active and task_state rescuing.
Nov 14 14:54:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-04891050-36ba-49bc-bffb-439c65a4cfa6 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:54:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:54:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-changed-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Refreshing instance network info cache due to event network-changed-8705205c-f3e0-4a7e-8e8b-29675e4db47f. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:54:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] Acquiring lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] Acquired lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:47 user nova-compute[75292]: DEBUG nova.network.neutron [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Refreshing network info cache for port 8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:54:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updated VIF entry in instance network info cache for port 8705205c-f3e0-4a7e-8e8b-29675e4db47f. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:54:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updating instance_info_cache with network_info: [{"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-46438620-757b-48db-b3d3-f376d2abe20d req-49ef0dad-6165-4e76-b01c-0299614183ba service nova] Releasing lock "refresh_cache-b66c8072-5bdd-4f9d-8828-a691fe539d23" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:54:53 user nova-compute[75292]: INFO nova.compute.claims [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Claim successful on node user
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:54:53 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.network.neutron [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:54:53 user nova-compute[75292]: INFO nova.virt.block_device [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Booting with volume snapshot 276f4080-d0f9-44dc-a22a-7ce6b5ae6886 at /dev/vda
Nov 14 14:54:53 user nova-compute[75292]: DEBUG nova.policy [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12846e84377c40998d795e5f0b09252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebd367820b4847b1f8b7c402a22ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:54:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Successfully created port: f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Successfully updated port: f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquired lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-changed-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Refreshing instance network info cache due to event network-changed-f3ac0616-6932-43e3-b884-c916f9e0d7d5. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] Acquiring lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.network.neutron [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updating instance_info_cache with network_info: [{"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Releasing lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Instance network_info: |[{"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] Acquired lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Refreshing network info cache for port f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:54:56 user nova-compute[75292]: DEBUG nova.network.neutron [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updated VIF entry in instance network info cache for port f3ac0616-6932-43e3-b884-c916f9e0d7d5. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:54:56 user nova-compute[75292]: DEBUG nova.network.neutron [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updating instance_info_cache with network_info: [{"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-34d6c705-4020-4cf5-b9ea-532ca3180731 req-e6fb0771-b602-4854-a5be-83a57067a402 service nova] Releasing lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-changed-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Refreshing instance network info cache due to event network-changed-4b040e32-004c-4884-b186-37aabbebaee8. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] Acquiring lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] Acquired lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG nova.network.neutron [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Refreshing network info cache for port 4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:58 user nova-compute[75292]: INFO nova.compute.manager [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Terminating instance
Nov 14 14:54:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.network.neutron [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Updated VIF entry in instance network info cache for port 4b040e32-004c-4884-b186-37aabbebaee8. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.network.neutron [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Updating instance_info_cache with network_info: [{"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f6e8d319-9627-4c8d-81a6-139f2d0a1828 req-92bafc01-1ae0-4432-bf82-ed26d550448c service nova] Releasing lock "refresh_cache-f006fb97-1e8c-4501-b976-12fba9343f4e" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-3059cb14-4ef5-4f50-9ee4-80865de020da req-fc6216a3-7977-4469-a7a7-e3a468087f74 service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-vif-unplugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3059cb14-4ef5-4f50-9ee4-80865de020da req-fc6216a3-7977-4469-a7a7-e3a468087f74 service nova] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3059cb14-4ef5-4f50-9ee4-80865de020da req-fc6216a3-7977-4469-a7a7-e3a468087f74 service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3059cb14-4ef5-4f50-9ee4-80865de020da req-fc6216a3-7977-4469-a7a7-e3a468087f74 service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-3059cb14-4ef5-4f50-9ee4-80865de020da req-fc6216a3-7977-4469-a7a7-e3a468087f74 service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] No waiting events found dispatching network-vif-unplugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-3059cb14-4ef5-4f50-9ee4-80865de020da req-fc6216a3-7977-4469-a7a7-e3a468087f74 service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-vif-unplugged-4b040e32-004c-4884-b186-37aabbebaee8 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:54:59 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Instance destroyed successfully.
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.objects.instance [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'resources' on Instance uuid f006fb97-1e8c-4501-b976-12fba9343f4e {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:53:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-383010013',display_name='tempest-AttachVolumeNegativeTest-server-383010013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-383010013',id=38,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYjXdQLk3gbh9hO2BWgbSJoDKl9doVHkDZPQ2Ey/eloBo8NRpQP9SBtwByoCMpC68mzyyKLcGMrZPqM2NBwpxY/qbsevSXwZSNd144dh0aGNgXTcrls2OG/IyYr3aS86Q==',key_name='tempest-keypair-55105243',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:53:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-sbgp93on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=f006fb97-1e8c-4501-b976-12fba9343f4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "4b040e32-004c-4884-b186-37aabbebaee8", "address": "fa:16:3e:05:6e:4f", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b040e32-00", "ovs_interfaceid": "4b040e32-004c-4884-b186-37aabbebaee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_vif [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b040e32-00, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64ce65d5-210d-4d49-9adf-e5e4c66b703f) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:54:59 user nova-compute[75292]: INFO os_vif [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:6e:4f,bridge_name='br-int',has_traffic_filtering=True,id=4b040e32-004c-4884-b186-37aabbebaee8,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b040e32-00')
Nov 14 14:54:59 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Deleting instance files /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e_del
Nov 14 14:54:59 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Deletion of /opt/stack/data/nova/instances/f006fb97-1e8c-4501-b976-12fba9343f4e_del complete
Nov 14 14:54:59 user nova-compute[75292]: INFO nova.compute.manager [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_brick.utils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c16d7-7174-4659-9830-8340aadd361b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b49ba7-c3f3-480c-8ab9-09201464b911]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f02d9-99b0-4f13-946a-c189ec7b4b08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd796a0-c548-4d53-a28f-546e70402052]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:54:59 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:54:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[30060b52-9ae2-4242-8163-7963838b4603]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG os_brick.utils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:54:59 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updating existing volume attachment record: b0c1c8a0-4a07-4482-9cab-ad90cbac93c8 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:55:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:00 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:00 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Took 1.07 seconds to deallocate network for instance.
Nov 14 14:55:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:01 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Deleted allocations for instance f006fb97-1e8c-4501-b976-12fba9343f4e
Nov 14 14:55:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52792326-67a8-4d4a-9fe1-e16144fda702 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] Acquiring lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] Lock "f006fb97-1e8c-4501-b976-12fba9343f4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] No waiting events found dispatching network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:01 user nova-compute[75292]: WARNING nova.compute.manager [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received unexpected event network-vif-plugged-4b040e32-004c-4884-b186-37aabbebaee8 for instance with vm_state deleted and task_state None.
Nov 14 14:55:01 user nova-compute[75292]: DEBUG nova.compute.manager [req-a4aa80f0-5f16-49a1-893d-0639bd9b8cb0 req-a5f2a79c-5b89-4af2-b189-734f92db918f service nova] [instance: f006fb97-1e8c-4501-b976-12fba9343f4e] Received event network-vif-deleted-4b040e32-004c-4884-b186-37aabbebaee8 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:55:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Creating image(s)
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Ensure instance console log exists: /opt/stack/data/nova/instances/2f807044-3d09-4b41-a59a-88ce1fbbdf2a/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Start _get_guest_xml network_info=[{"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T14:54:49Z,direct_url=<?>,disk_format='qcow2',id=38c1b9d3-82d3-4b71-8833-b85d8e723870,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1371838577',owner='6cebd367820b4847b1f8b7c402a22ffc',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T14:54:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b0c1c8a0-4a07-4482-9cab-ad90cbac93c8', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUlBvETu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f807044-3d09-4b41-a59a-88ce1fbbdf2a', 'attached_at': '', 'detached_at': '', 'volume_id': '4fb98e7a-09df-4a17-a1bd-ae07ebbd473e', 'serial': '4fb98e7a-09df-4a17-a1bd-ae07ebbd473e'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': True, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:55:04 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:55:04 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T14:54:49Z,direct_url=<?>,disk_format='qcow2',id=38c1b9d3-82d3-4b71-8833-b85d8e723870,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1371838577',owner='6cebd367820b4847b1f8b7c402a22ffc',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T14:54:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUlBvETu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:55:04 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:55:04 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:55:04 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcf3b55-be19-4a8c-8dae-60c1a93cace1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:55:04 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[063117d9-e291-4a83-883d-1602c7179e2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e] added
Nov 14 14:55:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f155f5c-f159-4e9d-8b43-73002fce4767]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.050s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4ee842-f918-4571-a209-55d22758950c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUlBvETu {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VUlBvETu" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38ac78c-62b8-4224-972c-7c8fc4c20555]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VUlBvETu'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbc4799-10bd-4c7a-a0f5-da523aad97d9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[893d7f30-d9ce-46ed-881a-ed8144583a22]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1609a-c0aa-487c-ada3-fb6861343224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260]
Nov 14 14:55:04 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260] successful.
Nov 14 14:55:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b7cec-d587-4bfc-b9d2-837c80bc90af]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee449c0f-0d90-466c-873d-f6c4f34dcdfe]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)
Nov 14 14:55:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:55:04 user nova-compute[75292]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)
Nov 14 14:55:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fae518-fdba-4d2b-aa7b-fb7dea4c75ef]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUlBvETu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.compute.manager [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing instance network info cache due to event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:55:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updated VIF entry in instance network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3fb00e08-0615-4acd-a262-2e28600ebe66 req-26407cc3-dfc0-4c1f-b8b0-fc398e56bdf8 service nova] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23535623433353431', 'path': '/dev/sdf'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535623433353431', 'path': '/dev/sdf'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1801370681',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1801370681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1801370681',id=40,image_ref='38c1b9d3-82d3-4b71-8833-b85d8e723870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbTtGTSMfZ0fvkura3QwETRgIiKD1Rfy3qCNVXnChCi9PQ3H6+O+4MFP6von+0hQ6rEiBkODKBI8iTmwW5Lw4GfpD0qp4pcQDuNbZVW2Xqf0/3MF8uL9py5PdLiBr6kVA==',key_name='tempest-keypair-1002641155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-a5d9qbzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-53606599',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12846e84377c40998d795e5f0b09252f',uuid=2f807044-3d09-4b41-a59a-88ce1fbbdf2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.objects.instance [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f807044-3d09-4b41-a59a-88ce1fbbdf2a {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:55:05 user nova-compute[75292]:   <uuid>2f807044-3d09-4b41-a59a-88ce1fbbdf2a</uuid>
Nov 14 14:55:05 user nova-compute[75292]:   <name>instance-00000028</name>
Nov 14 14:55:05 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:55:05 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:55:05 user nova-compute[75292]:   <metadata>
Nov 14 14:55:05 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:55:05 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:55:05 user nova-compute[75292]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1801370681</nova:name>
Nov 14 14:55:05 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:55:04</nova:creationTime>
Nov 14 14:55:05 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:55:05 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:55:05 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:55:05 user nova-compute[75292]:       <nova:owner>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:user uuid="12846e84377c40998d795e5f0b09252f">tempest-TestVolumeBootPattern-53606599-project-member</nova:user>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:project uuid="6cebd367820b4847b1f8b7c402a22ffc">tempest-TestVolumeBootPattern-53606599</nova:project>
Nov 14 14:55:05 user nova-compute[75292]:       </nova:owner>
Nov 14 14:55:05 user nova-compute[75292]:       <nova:root type="image" uuid="38c1b9d3-82d3-4b71-8833-b85d8e723870"/>
Nov 14 14:55:05 user nova-compute[75292]:       <nova:ports>
Nov 14 14:55:05 user nova-compute[75292]:         <nova:port uuid="f3ac0616-6932-43e3-b884-c916f9e0d7d5">
Nov 14 14:55:05 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 14:55:05 user nova-compute[75292]:         </nova:port>
Nov 14 14:55:05 user nova-compute[75292]:       </nova:ports>
Nov 14 14:55:05 user nova-compute[75292]:     </nova:instance>
Nov 14 14:55:05 user nova-compute[75292]:   </metadata>
Nov 14 14:55:05 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:55:05 user nova-compute[75292]:     <system>
Nov 14 14:55:05 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:55:05 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:55:05 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:55:05 user nova-compute[75292]:       <entry name="serial">2f807044-3d09-4b41-a59a-88ce1fbbdf2a</entry>
Nov 14 14:55:05 user nova-compute[75292]:       <entry name="uuid">2f807044-3d09-4b41-a59a-88ce1fbbdf2a</entry>
Nov 14 14:55:05 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:55:05 user nova-compute[75292]:     </system>
Nov 14 14:55:05 user nova-compute[75292]:   </sysinfo>
Nov 14 14:55:05 user nova-compute[75292]:   <os>
Nov 14 14:55:05 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:55:05 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:55:05 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:55:05 user nova-compute[75292]:   </os>
Nov 14 14:55:05 user nova-compute[75292]:   <features>
Nov 14 14:55:05 user nova-compute[75292]:     <acpi/>
Nov 14 14:55:05 user nova-compute[75292]:     <apic/>
Nov 14 14:55:05 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:55:05 user nova-compute[75292]:   </features>
Nov 14 14:55:05 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:55:05 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:55:05 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:55:05 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:55:05 user nova-compute[75292]:   </clock>
Nov 14 14:55:05 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:55:05 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:55:05 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:55:05 user nova-compute[75292]:   </cpu>
Nov 14 14:55:05 user nova-compute[75292]:   <devices>
Nov 14 14:55:05 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:55:05 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:55:05 user nova-compute[75292]:       <source dev="/dev/sdf"/>
Nov 14 14:55:05 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:55:05 user nova-compute[75292]:       <serial>4fb98e7a-09df-4a17-a1bd-ae07ebbd473e</serial>
Nov 14 14:55:05 user nova-compute[75292]:     </disk>
Nov 14 14:55:05 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:55:05 user nova-compute[75292]:       <mac address="fa:16:3e:31:73:67"/>
Nov 14 14:55:05 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:55:05 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:55:05 user nova-compute[75292]:       <target dev="tapf3ac0616-69"/>
Nov 14 14:55:05 user nova-compute[75292]:     </interface>
Nov 14 14:55:05 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:55:05 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/2f807044-3d09-4b41-a59a-88ce1fbbdf2a/console.log" append="off"/>
Nov 14 14:55:05 user nova-compute[75292]:     </serial>
Nov 14 14:55:05 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:55:05 user nova-compute[75292]:     <video>
Nov 14 14:55:05 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:55:05 user nova-compute[75292]:     </video>
Nov 14 14:55:05 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:55:05 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:55:05 user nova-compute[75292]:     </rng>
Nov 14 14:55:05 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:55:05 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:55:05 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:55:05 user nova-compute[75292]:     </memballoon>
Nov 14 14:55:05 user nova-compute[75292]:   </devices>
Nov 14 14:55:05 user nova-compute[75292]: </domain>
Nov 14 14:55:05 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1801370681',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1801370681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1801370681',id=40,image_ref='38c1b9d3-82d3-4b71-8833-b85d8e723870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbTtGTSMfZ0fvkura3QwETRgIiKD1Rfy3qCNVXnChCi9PQ3H6+O+4MFP6von+0hQ6rEiBkODKBI8iTmwW5Lw4GfpD0qp4pcQDuNbZVW2Xqf0/3MF8uL9py5PdLiBr6kVA==',key_name='tempest-keypair-1002641155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-a5d9qbzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-53606599',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12846e84377c40998d795e5f0b09252f',uuid=2f807044-3d09-4b41-a59a-88ce1fbbdf2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG os_vif [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b08e4bc-6502-5353-a880-965a8afc6fb4', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3ac0616-69, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3ac0616-69, col_values=(('qos', UUID('5fe2d4a5-be90-446d-8263-7d61cbbca4cd')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3ac0616-69, col_values=(('external_ids', {'iface-id': 'f3ac0616-6932-43e3-b884-c916f9e0d7d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:73:67', 'vm-uuid': '2f807044-3d09-4b41-a59a-88ce1fbbdf2a'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:05 user nova-compute[75292]: INFO os_vif [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69')
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:55:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No VIF found with MAC fa:16:3e:31:73:67, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-5da60937-6e2a-402e-9957-05e2ed0c3ea1 req-3f717f57-2175-4e58-bc9f-6ca07de64d00 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5da60937-6e2a-402e-9957-05e2ed0c3ea1 req-3f717f57-2175-4e58-bc9f-6ca07de64d00 service nova] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5da60937-6e2a-402e-9957-05e2ed0c3ea1 req-3f717f57-2175-4e58-bc9f-6ca07de64d00 service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5da60937-6e2a-402e-9957-05e2ed0c3ea1 req-3f717f57-2175-4e58-bc9f-6ca07de64d00 service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-5da60937-6e2a-402e-9957-05e2ed0c3ea1 req-3f717f57-2175-4e58-bc9f-6ca07de64d00 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] No waiting events found dispatching network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:07 user nova-compute[75292]: WARNING nova.compute.manager [req-5da60937-6e2a-402e-9957-05e2ed0c3ea1 req-3f717f57-2175-4e58-bc9f-6ca07de64d00 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received unexpected event network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 for instance with vm_state building and task_state spawning.
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:07 user nova-compute[75292]: INFO nova.compute.manager [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Shelving
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-46469af1-6547-4257-840a-3f33f2d708c8 req-f3893064-9676-47ab-a234-84c35b33d281 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-unplugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-46469af1-6547-4257-840a-3f33f2d708c8 req-f3893064-9676-47ab-a234-84c35b33d281 service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-46469af1-6547-4257-840a-3f33f2d708c8 req-f3893064-9676-47ab-a234-84c35b33d281 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-46469af1-6547-4257-840a-3f33f2d708c8 req-f3893064-9676-47ab-a234-84c35b33d281 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-46469af1-6547-4257-840a-3f33f2d708c8 req-f3893064-9676-47ab-a234-84c35b33d281 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-unplugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:07 user nova-compute[75292]: WARNING nova.compute.manager [req-46469af1-6547-4257-840a-3f33f2d708c8 req-f3893064-9676-47ab-a234-84c35b33d281 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-unplugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state active and task_state shelving.
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance destroyed successfully.
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Beginning cold snapshot process
Nov 14 14:55:08 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk /opt/stack/data/nova/instances/snapshots/tmp6m820g1q/2498c689f2bf4c76abea343f0ba8d72e {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-1e076155-bb22-445e-89bc-c46cc9ab8798 req-2542f660-3e7a-4d15-b77d-355fa90d89f8 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1e076155-bb22-445e-89bc-c46cc9ab8798 req-2542f660-3e7a-4d15-b77d-355fa90d89f8 service nova] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1e076155-bb22-445e-89bc-c46cc9ab8798 req-2542f660-3e7a-4d15-b77d-355fa90d89f8 service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1e076155-bb22-445e-89bc-c46cc9ab8798 req-2542f660-3e7a-4d15-b77d-355fa90d89f8 service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-1e076155-bb22-445e-89bc-c46cc9ab8798 req-2542f660-3e7a-4d15-b77d-355fa90d89f8 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] No waiting events found dispatching network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:09 user nova-compute[75292]: WARNING nova.compute.manager [req-1e076155-bb22-445e-89bc-c46cc9ab8798 req-2542f660-3e7a-4d15-b77d-355fa90d89f8 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received unexpected event network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 for instance with vm_state building and task_state spawning.
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:55:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Instance spawned successfully.
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:09 user nova-compute[75292]: INFO nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk /opt/stack/data/nova/instances/snapshots/tmp6m820g1q/2498c689f2bf4c76abea343f0ba8d72e" returned: 0 in 1.148s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Snapshot extracted, beginning image upload
Nov 14 14:55:09 user nova-compute[75292]: INFO nova.compute.manager [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Took 16.36 seconds to build instance.
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-180304db-4200-4a81-981f-2058e5ec7da1 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.461s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-bf7e1431-ce99-4c5b-8704-c2de84c9aa51 req-939b601e-8a90-43ff-963e-80f03a4c045d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf7e1431-ce99-4c5b-8704-c2de84c9aa51 req-939b601e-8a90-43ff-963e-80f03a4c045d service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf7e1431-ce99-4c5b-8704-c2de84c9aa51 req-939b601e-8a90-43ff-963e-80f03a4c045d service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-bf7e1431-ce99-4c5b-8704-c2de84c9aa51 req-939b601e-8a90-43ff-963e-80f03a4c045d service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-bf7e1431-ce99-4c5b-8704-c2de84c9aa51 req-939b601e-8a90-43ff-963e-80f03a4c045d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:09 user nova-compute[75292]: WARNING nova.compute.manager [req-bf7e1431-ce99-4c5b-8704-c2de84c9aa51 req-939b601e-8a90-43ff-963e-80f03a4c045d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 14:55:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Snapshot image upload complete
Nov 14 14:55:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:55:12 user nova-compute[75292]: INFO nova.compute.manager [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Shelve offloading
Nov 14 14:55:12 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance destroyed successfully.
Nov 14 14:55:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:55:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:55:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:55:12 user nova-compute[75292]: DEBUG nova.network.neutron [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.network.neutron [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:55:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance destroyed successfully.
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'resources' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1491484863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1491484863',id=39,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHia5k7NRXViV0XgNAyzDXay3u7jjO0eHRVzHcAXEXTN5yukqVmfCFFlxnczgbajI4Olo3rSbn71LbM5K+TBQI2xLK6qkg1LafYuZIdb9wrUTVicAw4/7xxTMOjXLiosbA==',key_name='tempest-keypair-1738255639',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:53:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-y01osgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member',shelved_at='2023-11-14T14:55:12.624456',shelved_host='user',shelved_image_id='8b953a96-3928-47f0-ad84-dfd61e7c184a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=ed79b252-324c-461d-bd4b-bc379d1a1bb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG os_vif [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5962ed86-a9, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=287d7215-abf1-4c82-bdf9-9d7f6478a94d) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:13 user nova-compute[75292]: INFO os_vif [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9')
Nov 14 14:55:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Deleting instance files /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7_del
Nov 14 14:55:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Deletion of /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7_del complete
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing instance network info cache due to event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:55:13 user nova-compute[75292]: DEBUG nova.network.neutron [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:55:14 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Deleted allocations for instance ed79b252-324c-461d-bd4b-bc379d1a1bb7
Nov 14 14:55:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG nova.objects.instance [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'numa_topology' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG nova.objects.base [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<ed79b252-324c-461d-bd4b-bc379d1a1bb7> lazy-loaded attributes: resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updated VIF entry in instance network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG nova.network.neutron [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5962ed86-a9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c9b2cb70-4888-49be-938a-57ce990a1774 req-f5692ae5-01e6-4986-9107-6b95d4056f54 service nova] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-52ed7a05-f82c-4a0a-b2e6-c784631b2c92 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.989s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:15 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:55:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:55:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:55:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:55:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Updating instance_info_cache with network_info: [{"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-c4450564-68bb-4ee9-ab0b-9100ce602a46" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:55:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:55:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:22 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:55:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:25 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:55:27 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:55:27 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:55:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8166MB free_disk=25.080768585205078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 52818903-146d-429a-893e-3f6da6a8a17c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance adcd9c44-c430-46ea-986d-b4f7b7888122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b66c8072-5bdd-4f9d-8828-a691fe539d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 2f807044-3d09-4b41-a59a-88ce1fbbdf2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:55:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:55:46 user nova-compute[75292]: INFO nova.compute.claims [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Claim successful on node user
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:55:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:55:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.policy [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '480acd7147c34f58b39676cc2ec82397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b370479854d4135964bb1c3af954e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:55:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Creating image(s)
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "/opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "/opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk 1073741824" returned: 0 in 0.048s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Successfully created port: 0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Cannot resize image /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Ensure instance console log exists: /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Successfully updated port: 0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquired lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-changed-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Refreshing instance network info cache due to event network-changed-0a6d4cce-e288-4be0-a978-dd4ff32f5173. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] Acquiring lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating instance_info_cache with network_info: [{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Releasing lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Instance network_info: |[{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] Acquired lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.network.neutron [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Refreshing network info cache for port 0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Start _get_guest_xml network_info=[{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:55:48 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:55:48 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:55:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:55:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2088534401',display_name='tempest-TestStampPattern-server-2088534401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2088534401',id=41,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4X0bZ2E6lTaWCurq+vNQ7Eay1a1PgR3+amBQH2b8b5jqS2H83E4VO6gRrOd1s0X09OzYJn0hNdn8zkkqzW1XjZt3CYTTnX+OOgkotOanJ2EWGZB8tKp2PnXsl8eozlw==',key_name='tempest-TestStampPattern-2124283914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b370479854d4135964bb1c3af954e96',ramdisk_id='',reservation_id='r-arukg9e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069546202',owner_user_name='tempest-TestStampPattern-2069546202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:55:47Z,user_data=None,user_id='480acd7147c34f58b39676cc2ec82397',uuid=9b1e65d4-38d6-4959-8dda-40d33b83a895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converting VIF {"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:55:49 user nova-compute[75292]:   <uuid>9b1e65d4-38d6-4959-8dda-40d33b83a895</uuid>
Nov 14 14:55:49 user nova-compute[75292]:   <name>instance-00000029</name>
Nov 14 14:55:49 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:55:49 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:55:49 user nova-compute[75292]:   <metadata>
Nov 14 14:55:49 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:55:49 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:55:49 user nova-compute[75292]:       <nova:name>tempest-TestStampPattern-server-2088534401</nova:name>
Nov 14 14:55:49 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:55:48</nova:creationTime>
Nov 14 14:55:49 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:55:49 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:55:49 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:55:49 user nova-compute[75292]:       <nova:owner>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:user uuid="480acd7147c34f58b39676cc2ec82397">tempest-TestStampPattern-2069546202-project-member</nova:user>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:project uuid="0b370479854d4135964bb1c3af954e96">tempest-TestStampPattern-2069546202</nova:project>
Nov 14 14:55:49 user nova-compute[75292]:       </nova:owner>
Nov 14 14:55:49 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:55:49 user nova-compute[75292]:       <nova:ports>
Nov 14 14:55:49 user nova-compute[75292]:         <nova:port uuid="0a6d4cce-e288-4be0-a978-dd4ff32f5173">
Nov 14 14:55:49 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 14:55:49 user nova-compute[75292]:         </nova:port>
Nov 14 14:55:49 user nova-compute[75292]:       </nova:ports>
Nov 14 14:55:49 user nova-compute[75292]:     </nova:instance>
Nov 14 14:55:49 user nova-compute[75292]:   </metadata>
Nov 14 14:55:49 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:55:49 user nova-compute[75292]:     <system>
Nov 14 14:55:49 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:55:49 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:55:49 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:55:49 user nova-compute[75292]:       <entry name="serial">9b1e65d4-38d6-4959-8dda-40d33b83a895</entry>
Nov 14 14:55:49 user nova-compute[75292]:       <entry name="uuid">9b1e65d4-38d6-4959-8dda-40d33b83a895</entry>
Nov 14 14:55:49 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:55:49 user nova-compute[75292]:     </system>
Nov 14 14:55:49 user nova-compute[75292]:   </sysinfo>
Nov 14 14:55:49 user nova-compute[75292]:   <os>
Nov 14 14:55:49 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:55:49 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:55:49 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:55:49 user nova-compute[75292]:   </os>
Nov 14 14:55:49 user nova-compute[75292]:   <features>
Nov 14 14:55:49 user nova-compute[75292]:     <acpi/>
Nov 14 14:55:49 user nova-compute[75292]:     <apic/>
Nov 14 14:55:49 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:55:49 user nova-compute[75292]:   </features>
Nov 14 14:55:49 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:55:49 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:55:49 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:55:49 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:55:49 user nova-compute[75292]:   </clock>
Nov 14 14:55:49 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:55:49 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:55:49 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:55:49 user nova-compute[75292]:   </cpu>
Nov 14 14:55:49 user nova-compute[75292]:   <devices>
Nov 14 14:55:49 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:55:49 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:55:49 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk"/>
Nov 14 14:55:49 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:55:49 user nova-compute[75292]:     </disk>
Nov 14 14:55:49 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:55:49 user nova-compute[75292]:       <mac address="fa:16:3e:f2:16:10"/>
Nov 14 14:55:49 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:55:49 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:55:49 user nova-compute[75292]:       <target dev="tap0a6d4cce-e2"/>
Nov 14 14:55:49 user nova-compute[75292]:     </interface>
Nov 14 14:55:49 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:55:49 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/console.log" append="off"/>
Nov 14 14:55:49 user nova-compute[75292]:     </serial>
Nov 14 14:55:49 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:55:49 user nova-compute[75292]:     <video>
Nov 14 14:55:49 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:55:49 user nova-compute[75292]:     </video>
Nov 14 14:55:49 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:55:49 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:55:49 user nova-compute[75292]:     </rng>
Nov 14 14:55:49 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:55:49 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:55:49 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:55:49 user nova-compute[75292]:     </memballoon>
Nov 14 14:55:49 user nova-compute[75292]:   </devices>
Nov 14 14:55:49 user nova-compute[75292]: </domain>
Nov 14 14:55:49 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:55:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2088534401',display_name='tempest-TestStampPattern-server-2088534401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2088534401',id=41,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4X0bZ2E6lTaWCurq+vNQ7Eay1a1PgR3+amBQH2b8b5jqS2H83E4VO6gRrOd1s0X09OzYJn0hNdn8zkkqzW1XjZt3CYTTnX+OOgkotOanJ2EWGZB8tKp2PnXsl8eozlw==',key_name='tempest-TestStampPattern-2124283914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b370479854d4135964bb1c3af954e96',ramdisk_id='',reservation_id='r-arukg9e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069546202',owner_user_name='tempest-TestStampPattern-2069546202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:55:47Z,user_data=None,user_id='480acd7147c34f58b39676cc2ec82397',uuid=9b1e65d4-38d6-4959-8dda-40d33b83a895,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converting VIF {"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG os_vif [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ed97a05-7b07-5e96-be44-0f490bcfc76d', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a6d4cce-e2, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a6d4cce-e2, col_values=(('qos', UUID('852212b7-7f66-42b9-b7ae-773160cc5b64')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a6d4cce-e2, col_values=(('external_ids', {'iface-id': '0a6d4cce-e288-4be0-a978-dd4ff32f5173', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:16:10', 'vm-uuid': '9b1e65d4-38d6-4959-8dda-40d33b83a895'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:49 user nova-compute[75292]: INFO os_vif [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2')
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No VIF found with MAC fa:16:3e:f2:16:10, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.network.neutron [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updated VIF entry in instance network info cache for port 0a6d4cce-e288-4be0-a978-dd4ff32f5173. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG nova.network.neutron [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating instance_info_cache with network_info: [{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:55:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fe27a250-aff6-4a9a-b0a9-f33faafe8faa req-f8e13210-17eb-4fb2-af9e-0609ecb80da3 service nova] Releasing lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:50 user nova-compute[75292]: INFO nova.compute.manager [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Detaching volume 2c912d9e-4c08-40de-9a63-b6fa0115373e
Nov 14 14:55:50 user nova-compute[75292]: INFO nova.virt.block_device [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Attempting to driver detach volume 2c912d9e-4c08-40de-9a63-b6fa0115373e from mountpoint /dev/vdb
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Attempting to detach device vdb from instance 52818903-146d-429a-893e-3f6da6a8a17c from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:55:50 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:55:50 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:55:50 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:55:50 user nova-compute[75292]:   <serial>2c912d9e-4c08-40de-9a63-b6fa0115373e</serial>
Nov 14 14:55:50 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:55:50 user nova-compute[75292]: </disk>
Nov 14 14:55:50 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:55:50 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully detached device vdb from instance 52818903-146d-429a-893e-3f6da6a8a17c from the persistent domain config.
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52818903-146d-429a-893e-3f6da6a8a17c from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:55:50 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:55:50 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:55:50 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:55:50 user nova-compute[75292]:   <serial>2c912d9e-4c08-40de-9a63-b6fa0115373e</serial>
Nov 14 14:55:50 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:55:50 user nova-compute[75292]: </disk>
Nov 14 14:55:50 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52818903-146d-429a-893e-3f6da6a8a17c {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-9567c650-b475-4484-8911-dcfa955a4986 req-799dc729-5835-402c-bec8-db1616ce138e service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9567c650-b475-4484-8911-dcfa955a4986 req-799dc729-5835-402c-bec8-db1616ce138e service nova] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9567c650-b475-4484-8911-dcfa955a4986 req-799dc729-5835-402c-bec8-db1616ce138e service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9567c650-b475-4484-8911-dcfa955a4986 req-799dc729-5835-402c-bec8-db1616ce138e service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-9567c650-b475-4484-8911-dcfa955a4986 req-799dc729-5835-402c-bec8-db1616ce138e service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] No waiting events found dispatching network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:50 user nova-compute[75292]: WARNING nova.compute.manager [req-9567c650-b475-4484-8911-dcfa955a4986 req-799dc729-5835-402c-bec8-db1616ce138e service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received unexpected event network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 for instance with vm_state building and task_state spawning.
Nov 14 14:55:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-2398a75d-774b-4730-b81e-4bf1e46a0389 req-fb679ed0-1a17-4bff-9449-d9f000ef1add service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2398a75d-774b-4730-b81e-4bf1e46a0389 req-fb679ed0-1a17-4bff-9449-d9f000ef1add service nova] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2398a75d-774b-4730-b81e-4bf1e46a0389 req-fb679ed0-1a17-4bff-9449-d9f000ef1add service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2398a75d-774b-4730-b81e-4bf1e46a0389 req-fb679ed0-1a17-4bff-9449-d9f000ef1add service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-2398a75d-774b-4730-b81e-4bf1e46a0389 req-fb679ed0-1a17-4bff-9449-d9f000ef1add service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] No waiting events found dispatching network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:55:52 user nova-compute[75292]: WARNING nova.compute.manager [req-2398a75d-774b-4730-b81e-4bf1e46a0389 req-fb679ed0-1a17-4bff-9449-d9f000ef1add service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received unexpected event network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 for instance with vm_state building and task_state spawning.
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:55:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Instance spawned successfully.
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:55:52 user nova-compute[75292]: INFO nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Took 5.89 seconds to spawn the instance on the hypervisor.
Nov 14 14:55:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:55:53 user nova-compute[75292]: INFO nova.compute.manager [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Took 6.59 seconds to build instance.
Nov 14 14:55:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2de8e032-a4df-4609-b76a-5e47303545cc tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.717s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:55:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:55:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:56:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 14:56:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:56:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 14:56:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:10 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 52818903-146d-429a-893e-3f6da6a8a17c is timed out.
Nov 14 14:56:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully detached device vdb from instance 52818903-146d-429a-893e-3f6da6a8a17c from the live domain config.
Nov 14 14:56:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SElOGcJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:56:10 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b9061-9cfd-4ac1-8a0d-27609e5df5d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:56:10 user nova-compute[75292]: No targets found.
Nov 14 14:56:10 user nova-compute[75292]: iSNS:
Nov 14 14:56:10 user nova-compute[75292]: No targets found.
Nov 14 14:56:10 user nova-compute[75292]: STATIC:
Nov 14 14:56:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:56:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3
Nov 14 14:56:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e
Nov 14 14:56:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:56:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e
Nov 14 14:56:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:10 user nova-compute[75292]: FIRMWARE:
Nov 14 14:56:10 user nova-compute[75292]: No targets found.
Nov 14 14:56:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:56:10 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:56:10 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[192b931b-d1f5-4069-bee4-42e3718939b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a3aac9-a59f-45cf-a398-d7f2d6df7054]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)
Nov 14 14:56:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:56:10 user nova-compute[75292]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)
Nov 14 14:56:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b540fea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e2221-130b-4c5e-9fc7-2377389f05c1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c416440-cdb3-439a-b02f-e23799b207bf]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d516b6b-5151-4d1d-bf70-cb03c9034c1a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c94a44-90d2-4e86-bb8d-27e6d7976846]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3337b41e-b3c6-49d7-9895-04dfb46cc77b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:56:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0942ba22-3b7b-4288-892f-2a0c077a4737]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260]
Nov 14 14:56:11 user nova-compute[75292]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e, portal: 172.16.0.220,3260] successful.
Nov 14 14:56:11 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c912d9e-4c08-40de-9a63-b6fa0115373e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af6859d-27e4-486f-85e3-6691f1ca90ae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== disconnect_volume: return (329ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG nova.objects.instance [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid 52818903-146d-429a-893e-3f6da6a8a17c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:56:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-45211778-eb99-485c-a556-9bb85562e56c tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:16 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:56:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:56:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:56:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:56:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updating instance_info_cache with network_info: [{"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:56:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-52818903-146d-429a-893e-3f6da6a8a17c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:56:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:56:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:25 user nova-compute[75292]: INFO nova.compute.manager [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Unrescuing
Nov 14 14:56:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquired lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating instance_info_cache with network_info: [{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Releasing lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'flavor' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a4ab0ab-217f-4a70-a914-2351fc93c455 req-d07a9712-34bb-4c7c-9021-6a1753ec52e3 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a4ab0ab-217f-4a70-a914-2351fc93c455 req-d07a9712-34bb-4c7c-9021-6a1753ec52e3 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a4ab0ab-217f-4a70-a914-2351fc93c455 req-d07a9712-34bb-4c7c-9021-6a1753ec52e3 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4a4ab0ab-217f-4a70-a914-2351fc93c455 req-d07a9712-34bb-4c7c-9021-6a1753ec52e3 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG nova.compute.manager [req-4a4ab0ab-217f-4a70-a914-2351fc93c455 req-d07a9712-34bb-4c7c-9021-6a1753ec52e3 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:25 user nova-compute[75292]: WARNING nova.compute.manager [req-4a4ab0ab-217f-4a70-a914-2351fc93c455 req-d07a9712-34bb-4c7c-9021-6a1753ec52e3 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:56:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance destroyed successfully.
Nov 14 14:56:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:27 user nova-compute[75292]: WARNING nova.compute.manager [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:56:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:27 user nova-compute[75292]: WARNING nova.compute.manager [req-b0a2f2f5-8c38-4cf7-8f6b-675c4d3624e7 req-00fa28e6-8396-41e8-a89b-a04acb9d9932 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-5a24a899-3561-4980-8ac1-ca99868c8ea2 req-6bf60ffd-83c1-4490-a8c3-3f3880d8fe57 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5a24a899-3561-4980-8ac1-ca99868c8ea2 req-6bf60ffd-83c1-4490-a8c3-3f3880d8fe57 service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5a24a899-3561-4980-8ac1-ca99868c8ea2 req-6bf60ffd-83c1-4490-a8c3-3f3880d8fe57 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5a24a899-3561-4980-8ac1-ca99868c8ea2 req-6bf60ffd-83c1-4490-a8c3-3f3880d8fe57 service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-5a24a899-3561-4980-8ac1-ca99868c8ea2 req-6bf60ffd-83c1-4490-a8c3-3f3880d8fe57 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:30 user nova-compute[75292]: WARNING nova.compute.manager [req-5a24a899-3561-4980-8ac1-ca99868c8ea2 req-6bf60ffd-83c1-4490-a8c3-3f3880d8fe57 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state rescued and task_state unrescuing.
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e9d243f1-d936-4785-8ddb-08fb0518efb8 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:56:30 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:56:30 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8155MB free_disk=25.041805267333984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 52818903-146d-429a-893e-3f6da6a8a17c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance adcd9c44-c430-46ea-986d-b4f7b7888122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b66c8072-5bdd-4f9d-8828-a691fe539d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 2f807044-3d09-4b41-a59a-88ce1fbbdf2a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:56:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:56:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:40 user nova-compute[75292]: INFO nova.compute.manager [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Terminating instance
Nov 14 14:56:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-c36856fe-5d49-493b-b73f-ca2197bb6a38 req-4b7f95fa-db40-4c52-bb45-008d1a3c9380 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-vif-unplugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c36856fe-5d49-493b-b73f-ca2197bb6a38 req-4b7f95fa-db40-4c52-bb45-008d1a3c9380 service nova] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c36856fe-5d49-493b-b73f-ca2197bb6a38 req-4b7f95fa-db40-4c52-bb45-008d1a3c9380 service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c36856fe-5d49-493b-b73f-ca2197bb6a38 req-4b7f95fa-db40-4c52-bb45-008d1a3c9380 service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-c36856fe-5d49-493b-b73f-ca2197bb6a38 req-4b7f95fa-db40-4c52-bb45-008d1a3c9380 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] No waiting events found dispatching network-vif-unplugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-c36856fe-5d49-493b-b73f-ca2197bb6a38 req-4b7f95fa-db40-4c52-bb45-008d1a3c9380 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-vif-unplugged-8821ecbc-47fb-4114-b050-0969d765f1ef for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:56:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Instance destroyed successfully.
Nov 14 14:56:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'resources' on Instance uuid 52818903-146d-429a-893e-3f6da6a8a17c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-924007152',display_name='tempest-AttachVolumeNegativeTest-server-924007152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-924007152',id=34,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDur19HmfjZFrqdAW+QoR14mAyeRD0Emk86TGofP3fhyKLKNY7Od+GRCSD8n6ZZcR36WdAPi25gixk87A2PxlUyarNs4mtFBBIfoorOiEi6A5p+4wsiAjQq+zcdquJp6Vw==',key_name='tempest-keypair-1565465919',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:51:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-sh68xysl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:51:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=52818903-146d-429a-893e-3f6da6a8a17c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "8821ecbc-47fb-4114-b050-0969d765f1ef", "address": "fa:16:3e:6e:30:23", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821ecbc-47", "ovs_interfaceid": "8821ecbc-47fb-4114-b050-0969d765f1ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG os_vif [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8821ecbc-47, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c23fe69b-39c2-422f-aaf6-b8a98efcbe87) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:56:41 user nova-compute[75292]: INFO os_vif [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:30:23,bridge_name='br-int',has_traffic_filtering=True,id=8821ecbc-47fb-4114-b050-0969d765f1ef,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821ecbc-47')
Nov 14 14:56:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Deleting instance files /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c_del
Nov 14 14:56:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Deletion of /opt/stack/data/nova/instances/52818903-146d-429a-893e-3f6da6a8a17c_del complete
Nov 14 14:56:41 user nova-compute[75292]: INFO nova.compute.manager [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 14:56:41 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:56:41 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:56:42 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Took 0.79 seconds to deallocate network for instance.
Nov 14 14:56:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-918c257d-0606-44ec-b401-8beb9fb60e76 req-022689a6-84b4-46e2-b397-45f10a8fa746 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-vif-deleted-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:42 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Deleted allocations for instance 52818903-146d-429a-893e-3f6da6a8a17c
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-49b3998b-d6bd-4399-add9-9b5a9d945d83 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "52818903-146d-429a-893e-3f6da6a8a17c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-6e46ae1b-98d0-45c4-b49d-4c7327e7df34 req-2307377e-7fe6-4f1b-9508-2cbe9e6ac0e6 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received event network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6e46ae1b-98d0-45c4-b49d-4c7327e7df34 req-2307377e-7fe6-4f1b-9508-2cbe9e6ac0e6 service nova] Acquiring lock "52818903-146d-429a-893e-3f6da6a8a17c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6e46ae1b-98d0-45c4-b49d-4c7327e7df34 req-2307377e-7fe6-4f1b-9508-2cbe9e6ac0e6 service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6e46ae1b-98d0-45c4-b49d-4c7327e7df34 req-2307377e-7fe6-4f1b-9508-2cbe9e6ac0e6 service nova] Lock "52818903-146d-429a-893e-3f6da6a8a17c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-6e46ae1b-98d0-45c4-b49d-4c7327e7df34 req-2307377e-7fe6-4f1b-9508-2cbe9e6ac0e6 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] No waiting events found dispatching network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:42 user nova-compute[75292]: WARNING nova.compute.manager [req-6e46ae1b-98d0-45c4-b49d-4c7327e7df34 req-2307377e-7fe6-4f1b-9508-2cbe9e6ac0e6 service nova] [instance: 52818903-146d-429a-893e-3f6da6a8a17c] Received unexpected event network-vif-plugged-8821ecbc-47fb-4114-b050-0969d765f1ef for instance with vm_state deleted and task_state None.
Nov 14 14:56:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-changed-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:44 user nova-compute[75292]: DEBUG nova.compute.manager [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Refreshing instance network info cache due to event network-changed-f3ac0616-6932-43e3-b884-c916f9e0d7d5. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:56:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] Acquiring lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:56:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] Acquired lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:56:44 user nova-compute[75292]: DEBUG nova.network.neutron [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Refreshing network info cache for port f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG nova.network.neutron [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updated VIF entry in instance network info cache for port f3ac0616-6932-43e3-b884-c916f9e0d7d5. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG nova.network.neutron [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updating instance_info_cache with network_info: [{"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-30f3e29f-d23c-4ba1-81ee-8fa608488601 req-8ccfbfaa-9a1a-4c32-aaed-b161b66254fa service nova] Releasing lock "refresh_cache-2f807044-3d09-4b41-a59a-88ce1fbbdf2a" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:45 user nova-compute[75292]: INFO nova.compute.manager [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Terminating instance
Nov 14 14:56:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-08164d31-c8e1-4692-a4ba-e1220f257021 req-48990191-dce1-416e-a9bd-f7a64b540aca service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-vif-unplugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-08164d31-c8e1-4692-a4ba-e1220f257021 req-48990191-dce1-416e-a9bd-f7a64b540aca service nova] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-08164d31-c8e1-4692-a4ba-e1220f257021 req-48990191-dce1-416e-a9bd-f7a64b540aca service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-08164d31-c8e1-4692-a4ba-e1220f257021 req-48990191-dce1-416e-a9bd-f7a64b540aca service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-08164d31-c8e1-4692-a4ba-e1220f257021 req-48990191-dce1-416e-a9bd-f7a64b540aca service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] No waiting events found dispatching network-vif-unplugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.compute.manager [req-08164d31-c8e1-4692-a4ba-e1220f257021 req-48990191-dce1-416e-a9bd-f7a64b540aca service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-vif-unplugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Instance destroyed successfully.
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'resources' on Instance uuid 2f807044-3d09-4b41-a59a-88ce1fbbdf2a {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1801370681',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1801370681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1801370681',id=40,image_ref='38c1b9d3-82d3-4b71-8833-b85d8e723870',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbTtGTSMfZ0fvkura3QwETRgIiKD1Rfy3qCNVXnChCi9PQ3H6+O+4MFP6von+0hQ6rEiBkODKBI8iTmwW5Lw4GfpD0qp4pcQDuNbZVW2Xqf0/3MF8uL9py5PdLiBr6kVA==',key_name='tempest-keypair-1002641155',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:55:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-a5d9qbzn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-53606599',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12846e84377c40998d795e5f0b09252f',uuid=2f807044-3d09-4b41-a59a-88ce1fbbdf2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "address": "fa:16:3e:31:73:67", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ac0616-69", "ovs_interfaceid": "f3ac0616-6932-43e3-b884-c916f9e0d7d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_vif [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3ac0616-69, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fe2d4a5-be90-446d-8263-7d61cbbca4cd) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:46 user nova-compute[75292]: INFO os_vif [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:73:67,bridge_name='br-int',has_traffic_filtering=True,id=f3ac0616-6932-43e3-b884-c916f9e0d7d5,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ac0616-69')
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VUlBvETu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:56:46 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[57104d09-e7f4-4fd9-a874-d64fd28c231e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:56:46 user nova-compute[75292]: No targets found.
Nov 14 14:56:46 user nova-compute[75292]: iSNS:
Nov 14 14:56:46 user nova-compute[75292]: No targets found.
Nov 14 14:56:46 user nova-compute[75292]: STATIC:
Nov 14 14:56:46 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:56:46 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:46 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:46 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3
Nov 14 14:56:46 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:46 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:46 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:56:46 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:46 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:46 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e
Nov 14 14:56:46 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:56:46 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:56:46 user nova-compute[75292]: FIRMWARE:
Nov 14 14:56:46 user nova-compute[75292]: No targets found.
Nov 14 14:56:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:56:46 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:56:46 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a6a98-59f0-4436-bdb7-73c58c7ef403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50a141-1133-4f42-b904-0ee1de35d25b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:56:46 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:56:46 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:56:46 user nova-compute[75292]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)
Nov 14 14:56:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:56:46 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:56:46 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:56:46 user nova-compute[75292]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e (non-flash)
Nov 14 14:56:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b54623be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e'): ({'sdf'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Removing single pathed devices sdf {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd294b95-296c-47bc-b055-3363cbfe5358]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e323d-042f-48a1-9df4-a61dfebb70a1]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flushing IO for device /dev/sdf {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f4ca0-4b72-4cf0-9e2e-3521ba10eb2d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7fc691-a8fe-48a9-ab40-e60c71c44613]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] SCSI volumes sdf have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd29232b-20f7-412f-9f12-d9dbc3f20ce4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e733a-28ef-439e-b8a9-542caec528cb]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260]
Nov 14 14:56:46 user nova-compute[75292]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e, portal: 172.16.0.220,3260] successful.
Nov 14 14:56:46 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fb98e7a-09df-4a17-a1bd-ae07ebbd473e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc939996-5c62-47e0-bb76-01e71b8a2314]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== disconnect_volume: return (314ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:56:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Deleting instance files /opt/stack/data/nova/instances/2f807044-3d09-4b41-a59a-88ce1fbbdf2a_del
Nov 14 14:56:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Deletion of /opt/stack/data/nova/instances/2f807044-3d09-4b41-a59a-88ce1fbbdf2a_del complete
Nov 14 14:56:46 user nova-compute[75292]: INFO nova.compute.manager [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 14:56:46 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:56:46 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:56:47 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:56:47 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Took 0.64 seconds to deallocate network for instance.
Nov 14 14:56:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-60921481-f4c3-4a4c-b93b-221ab0c7c714 req-03027e8b-b529-45bf-ab7e-b645cddbc8c3 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-vif-deleted-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-d7a01dfc-1e8e-410a-8606-358390fc791c req-ed26b158-f6bc-45ee-906b-145f56aa3921 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received event network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d7a01dfc-1e8e-410a-8606-358390fc791c req-ed26b158-f6bc-45ee-906b-145f56aa3921 service nova] Acquiring lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d7a01dfc-1e8e-410a-8606-358390fc791c req-ed26b158-f6bc-45ee-906b-145f56aa3921 service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-d7a01dfc-1e8e-410a-8606-358390fc791c req-ed26b158-f6bc-45ee-906b-145f56aa3921 service nova] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-d7a01dfc-1e8e-410a-8606-358390fc791c req-ed26b158-f6bc-45ee-906b-145f56aa3921 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] No waiting events found dispatching network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:56:48 user nova-compute[75292]: WARNING nova.compute.manager [req-d7a01dfc-1e8e-410a-8606-358390fc791c req-ed26b158-f6bc-45ee-906b-145f56aa3921 service nova] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Received unexpected event network-vif-plugged-f3ac0616-6932-43e3-b884-c916f9e0d7d5 for instance with vm_state active and task_state deleting.
Nov 14 14:56:48 user nova-compute[75292]: INFO nova.compute.manager [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 14:56:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 2f807044-3d09-4b41-a59a-88ce1fbbdf2a] Deleting volume: 4fb98e7a-09df-4a17-a1bd-ae07ebbd473e {{(pid=75292) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:48 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Deleted allocations for instance 2f807044-3d09-4b41-a59a-88ce1fbbdf2a
Nov 14 14:56:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8e173fd8-9d24-40fd-8db2-306cd70d8426 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "2f807044-3d09-4b41-a59a-88ce1fbbdf2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.996s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:56:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:56:59 user nova-compute[75292]: INFO nova.compute.manager [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Unshelving
Nov 14 14:56:59 user nova-compute[75292]: INFO nova.virt.block_device [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Booting with volume edc5c9ee-aa49-4f6a-881d-37c2f9a905cf at /dev/vdc
Nov 14 14:56:59 user nova-compute[75292]: DEBUG os_brick.utils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[879b8f06-2413-440c-b485-fca750a75dd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1efff5-fc65-451d-9132-163b2d56989b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8001a113-8fe6-4a2b-9b45-db9d3ed3b1f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1640561-1a58-4853-96a5-ac966382e6fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:56:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:57:00 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:57:00 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[70842232-3abf-4e04-925c-42ca97530355]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG os_brick.utils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating existing volume attachment record: f251949a-2d76-4d9c-8e73-dac3e8d93bae {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:57:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'pci_requests' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'numa_topology' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:57:04 user nova-compute[75292]: INFO nova.compute.claims [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Claim successful on node user
Nov 14 14:57:04 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:57:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:04 user nova-compute[75292]: INFO nova.network.neutron [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating port 5962ed86-a94f-4ee3-a048-e67a38860eb0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing instance network info cache due to event network-changed-5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] Acquiring lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.network.neutron [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:57:05 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Creating image(s)
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] Acquired lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.network.neutron [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Refreshing network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG nova.objects.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<ed79b252-324c-461d-bd4b-bc379d1a1bb7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "008b070e516e1a084ec2129b98c69d46b7a7d342" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "008b070e516e1a084ec2129b98c69d46b7a7d342" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:06 user nova-compute[75292]: DEBUG nova.virt.images [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] 8b953a96-3928-47f0-ad84-dfd61e7c184a was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:57:06 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:57:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.part /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updated VIF entry in instance network info cache for port 5962ed86-a94f-4ee3-a048-e67a38860eb0. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a9254f52-37bb-4085-a93a-1170059b0ec3 req-28c693b2-222e-4143-bd24-59da6d299358 service nova] Releasing lock "refresh_cache-ed79b252-324c-461d-bd4b-bc379d1a1bb7" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.part /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.converted" returned: 0 in 0.495s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "008b070e516e1a084ec2129b98c69d46b7a7d342" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.918s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "008b070e516e1a084ec2129b98c69d46b7a7d342" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "008b070e516e1a084ec2129b98c69d46b7a7d342" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:07 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342,backing_fmt=raw /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342,backing_fmt=raw /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk 1073741824" returned: 0 in 0.051s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "008b070e516e1a084ec2129b98c69d46b7a7d342" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'migration_context' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG nova.objects.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<ed79b252-324c-461d-bd4b-bc379d1a1bb7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:57:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Rebasing disk image.
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b -F raw /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b -F raw /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk" returned: 0 in 2.249s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Ensure instance console log exists: /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Start _get_guest_xml network_info=[{"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d5db7d1e7685cf9941e5d1458d7a889c',container_format='bare',created_at=2023-11-14T14:55:07Z,direct_url=<?>,disk_format='qcow2',id=8b953a96-3928-47f0-ad84-dfd61e7c184a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1491484863-shelved',owner='3f7526301dd346a9a6f3367417755a67',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T14:55:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f251949a-2d76-4d9c-8e73-dac3e8d93bae', 'boot_index': None, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIQYNntH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ed79b252-324c-461d-bd4b-bc379d1a1bb7', 'attached_at': '', 'detached_at': '', 'volume_id': 'edc5c9ee-aa49-4f6a-881d-37c2f9a905cf', 'serial': 'edc5c9ee-aa49-4f6a-881d-37c2f9a905cf'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:57:10 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:57:10 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d5db7d1e7685cf9941e5d1458d7a889c',container_format='bare',created_at=2023-11-14T14:55:07Z,direct_url=<?>,disk_format='qcow2',id=8b953a96-3928-47f0-ad84-dfd61e7c184a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1491484863-shelved',owner='3f7526301dd346a9a6f3367417755a67',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T14:55:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.objects.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<ed79b252-324c-461d-bd4b-bc379d1a1bb7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIQYNntH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:57:10 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:57:10 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:57:10 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164730d-9d38-4b0c-8151-3e786a6328e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:57:10 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1144e2e4-13e1-40d2-8367-fb04b788c64d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf] added
Nov 14 14:57:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef50ab9d-a599-4d0b-b14a-bf3e50f275e1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211df70-d7c9-4df2-89ee-adf2bdcf3d84]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cIQYNntH {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cIQYNntH" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe287930-7d02-4774-b895-5ce8f8524b69]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cIQYNntH'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[92394493-1222-4d0e-98ba-8548394e1307]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7bea5b-2408-4a31-99be-866f479840c7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a400b84-cb67-4b44-a5af-622696222545]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260]
Nov 14 14:57:10 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260] successful.
Nov 14 14:57:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b20d7e7-7522-4735-892f-78e66c405d42]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de0748-69cd-4dfe-b07e-54e42ccc5e66]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:57:10 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:57:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead30c0-6229-4e8e-a247-732e58ac1762]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:11 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:57:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIQYNntH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:57:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23762366432346434', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762366432346434', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1491484863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1491484863',id=39,image_ref='8b953a96-3928-47f0-ad84-dfd61e7c184a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1738255639',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:53:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-y01osgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member',shelved_at='2023-11-14T14:55:12.624456',shelved_host='user',shelved_image_id='8b953a96-3928-47f0-ad84-dfd61e7c184a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=ed79b252-324c-461d-bd4b-bc379d1a1bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'pci_devices' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.objects.base [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<ed79b252-324c-461d-bd4b-bc379d1a1bb7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:57:12 user nova-compute[75292]:   <uuid>ed79b252-324c-461d-bd4b-bc379d1a1bb7</uuid>
Nov 14 14:57:12 user nova-compute[75292]:   <name>instance-00000027</name>
Nov 14 14:57:12 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:57:12 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:57:12 user nova-compute[75292]:   <metadata>
Nov 14 14:57:12 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:57:12 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:57:12 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1491484863</nova:name>
Nov 14 14:57:12 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:57:10</nova:creationTime>
Nov 14 14:57:12 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:57:12 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:57:12 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:57:12 user nova-compute[75292]:       <nova:owner>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:user uuid="4b3312b416c74d92ae45d7edb5c08512">tempest-AttachVolumeShelveTestJSON-2139265145-project-member</nova:user>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:project uuid="3f7526301dd346a9a6f3367417755a67">tempest-AttachVolumeShelveTestJSON-2139265145</nova:project>
Nov 14 14:57:12 user nova-compute[75292]:       </nova:owner>
Nov 14 14:57:12 user nova-compute[75292]:       <nova:root type="image" uuid="8b953a96-3928-47f0-ad84-dfd61e7c184a"/>
Nov 14 14:57:12 user nova-compute[75292]:       <nova:ports>
Nov 14 14:57:12 user nova-compute[75292]:         <nova:port uuid="5962ed86-a94f-4ee3-a048-e67a38860eb0">
Nov 14 14:57:12 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 14:57:12 user nova-compute[75292]:         </nova:port>
Nov 14 14:57:12 user nova-compute[75292]:       </nova:ports>
Nov 14 14:57:12 user nova-compute[75292]:     </nova:instance>
Nov 14 14:57:12 user nova-compute[75292]:   </metadata>
Nov 14 14:57:12 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:57:12 user nova-compute[75292]:     <system>
Nov 14 14:57:12 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:57:12 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:57:12 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:57:12 user nova-compute[75292]:       <entry name="serial">ed79b252-324c-461d-bd4b-bc379d1a1bb7</entry>
Nov 14 14:57:12 user nova-compute[75292]:       <entry name="uuid">ed79b252-324c-461d-bd4b-bc379d1a1bb7</entry>
Nov 14 14:57:12 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:57:12 user nova-compute[75292]:     </system>
Nov 14 14:57:12 user nova-compute[75292]:   </sysinfo>
Nov 14 14:57:12 user nova-compute[75292]:   <os>
Nov 14 14:57:12 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:57:12 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:57:12 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:57:12 user nova-compute[75292]:   </os>
Nov 14 14:57:12 user nova-compute[75292]:   <features>
Nov 14 14:57:12 user nova-compute[75292]:     <acpi/>
Nov 14 14:57:12 user nova-compute[75292]:     <apic/>
Nov 14 14:57:12 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:57:12 user nova-compute[75292]:   </features>
Nov 14 14:57:12 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:57:12 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:57:12 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:57:12 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:57:12 user nova-compute[75292]:   </clock>
Nov 14 14:57:12 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:57:12 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:57:12 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:57:12 user nova-compute[75292]:   </cpu>
Nov 14 14:57:12 user nova-compute[75292]:   <devices>
Nov 14 14:57:12 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:57:12 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:57:12 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk"/>
Nov 14 14:57:12 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:57:12 user nova-compute[75292]:     </disk>
Nov 14 14:57:12 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:57:12 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:57:12 user nova-compute[75292]:       <source dev="/dev/sdc"/>
Nov 14 14:57:12 user nova-compute[75292]:       <target dev="vdc" bus="virtio"/>
Nov 14 14:57:12 user nova-compute[75292]:       <serial>edc5c9ee-aa49-4f6a-881d-37c2f9a905cf</serial>
Nov 14 14:57:12 user nova-compute[75292]:     </disk>
Nov 14 14:57:12 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:57:12 user nova-compute[75292]:       <mac address="fa:16:3e:5f:9f:00"/>
Nov 14 14:57:12 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:57:12 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:57:12 user nova-compute[75292]:       <target dev="tap5962ed86-a9"/>
Nov 14 14:57:12 user nova-compute[75292]:     </interface>
Nov 14 14:57:12 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:57:12 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/console.log" append="off"/>
Nov 14 14:57:12 user nova-compute[75292]:     </serial>
Nov 14 14:57:12 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:57:12 user nova-compute[75292]:     <video>
Nov 14 14:57:12 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:57:12 user nova-compute[75292]:     </video>
Nov 14 14:57:12 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:57:12 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:57:12 user nova-compute[75292]:     </rng>
Nov 14 14:57:12 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:57:12 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:57:12 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:57:12 user nova-compute[75292]:     </memballoon>
Nov 14 14:57:12 user nova-compute[75292]:   </devices>
Nov 14 14:57:12 user nova-compute[75292]: </domain>
Nov 14 14:57:12 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1491484863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1491484863',id=39,image_ref='8b953a96-3928-47f0-ad84-dfd61e7c184a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1738255639',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:53:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-y01osgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member',shelved_at='2023-11-14T14:55:12.624456',shelved_host='user',shelved_image_id='8b953a96-3928-47f0-ad84-dfd61e7c184a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:57:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=ed79b252-324c-461d-bd4b-bc379d1a1bb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG os_vif [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5df3b717-7663-5e18-b9e7-023aa7a59a56', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5962ed86-a9, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5962ed86-a9, col_values=(('qos', UUID('6754d040-489e-4f50-8846-05f030018102')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5962ed86-a9, col_values=(('external_ids', {'iface-id': '5962ed86-a94f-4ee3-a048-e67a38860eb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:9f:00', 'vm-uuid': 'ed79b252-324c-461d-bd4b-bc379d1a1bb7'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:12 user nova-compute[75292]: INFO os_vif [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9')
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:57:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No VIF found with MAC fa:16:3e:5f:9f:00, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-06205cd2-a28e-448e-9946-f24103b22a0f req-9263de05-b626-4ded-a20e-4d9a99a815b4 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-06205cd2-a28e-448e-9946-f24103b22a0f req-9263de05-b626-4ded-a20e-4d9a99a815b4 service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-06205cd2-a28e-448e-9946-f24103b22a0f req-9263de05-b626-4ded-a20e-4d9a99a815b4 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-06205cd2-a28e-448e-9946-f24103b22a0f req-9263de05-b626-4ded-a20e-4d9a99a815b4 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:13 user nova-compute[75292]: DEBUG nova.compute.manager [req-06205cd2-a28e-448e-9946-f24103b22a0f req-9263de05-b626-4ded-a20e-4d9a99a815b4 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:57:13 user nova-compute[75292]: WARNING nova.compute.manager [req-06205cd2-a28e-448e-9946-f24103b22a0f req-9263de05-b626-4ded-a20e-4d9a99a815b4 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 14:57:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:57:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance spawned successfully.
Nov 14 14:57:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-601c9500-d3f3-44d1-a6f7-dd28fa0ffe5a req-c8125029-5fc6-4bd1-a502-7c78b22d127e service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-601c9500-d3f3-44d1-a6f7-dd28fa0ffe5a req-c8125029-5fc6-4bd1-a502-7c78b22d127e service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-601c9500-d3f3-44d1-a6f7-dd28fa0ffe5a req-c8125029-5fc6-4bd1-a502-7c78b22d127e service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-601c9500-d3f3-44d1-a6f7-dd28fa0ffe5a req-c8125029-5fc6-4bd1-a502-7c78b22d127e service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG nova.compute.manager [req-601c9500-d3f3-44d1-a6f7-dd28fa0ffe5a req-c8125029-5fc6-4bd1-a502-7c78b22d127e service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:57:15 user nova-compute[75292]: WARNING nova.compute.manager [req-601c9500-d3f3-44d1-a6f7-dd28fa0ffe5a req-c8125029-5fc6-4bd1-a502-7c78b22d127e service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 14:57:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:57:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8cbd3360-57af-4dd1-b3f6-4bed8ddae216 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.223s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:17 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating instance_info_cache with network_info: [{"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-adcd9c44-c430-46ea-986d-b4f7b7888122" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:57:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:57:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:57:29 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:57:29 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:57:29 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=25.043914794921875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance adcd9c44-c430-46ea-986d-b4f7b7888122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance b66c8072-5bdd-4f9d-8828-a691fe539d23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:57:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:57:34 user nova-compute[75292]: INFO nova.compute.claims [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Claim successful on node user
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:57:34 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.policy [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3a7efbb426e4b558031f14a751e102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1d477a1d84afeb07533cddfe992d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:57:34 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Creating image(s)
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "/opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk 1073741824" returned: 0 in 0.064s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Successfully created port: 777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Cannot resize image /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Ensure instance console log exists: /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Successfully updated port: 777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquired lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-changed-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Refreshing instance network info cache due to event network-changed-777f46c6-4a36-4697-89cf-2a8ed6d4bef2. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] Acquiring lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:57:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updating instance_info_cache with network_info: [{"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Releasing lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Instance network_info: |[{"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] Acquired lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Refreshing network info cache for port 777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Start _get_guest_xml network_info=[{"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:57:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:57:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-421272435',display_name='tempest-AttachVolumeNegativeTest-server-421272435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-421272435',id=42,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJHmZXZSRALTnsXGuR7ZPP2CGymAUzjEM1Bw5uD7IIsk2QxRGWwbW1+BRILJ8udvqHNnwAOuixBnyjx9MRehwNtpedghQAaFV+AiBhSRXtbyKu+OUFxTCeaJXEeYbAQdA==',key_name='tempest-keypair-1058922560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-fbyix93c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=7eae039c-7751-46d6-b4c0-c15dc89a78b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.objects.instance [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'pci_devices' on Instance uuid 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:57:36 user nova-compute[75292]:   <uuid>7eae039c-7751-46d6-b4c0-c15dc89a78b9</uuid>
Nov 14 14:57:36 user nova-compute[75292]:   <name>instance-0000002a</name>
Nov 14 14:57:36 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:57:36 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:57:36 user nova-compute[75292]:   <metadata>
Nov 14 14:57:36 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:57:36 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:57:36 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeNegativeTest-server-421272435</nova:name>
Nov 14 14:57:36 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:57:36</nova:creationTime>
Nov 14 14:57:36 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:57:36 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:57:36 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:57:36 user nova-compute[75292]:       <nova:owner>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:user uuid="d3a7efbb426e4b558031f14a751e102b">tempest-AttachVolumeNegativeTest-547312228-project-member</nova:user>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:project uuid="8ae1d477a1d84afeb07533cddfe992d1">tempest-AttachVolumeNegativeTest-547312228</nova:project>
Nov 14 14:57:36 user nova-compute[75292]:       </nova:owner>
Nov 14 14:57:36 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 14:57:36 user nova-compute[75292]:       <nova:ports>
Nov 14 14:57:36 user nova-compute[75292]:         <nova:port uuid="777f46c6-4a36-4697-89cf-2a8ed6d4bef2">
Nov 14 14:57:36 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 14:57:36 user nova-compute[75292]:         </nova:port>
Nov 14 14:57:36 user nova-compute[75292]:       </nova:ports>
Nov 14 14:57:36 user nova-compute[75292]:     </nova:instance>
Nov 14 14:57:36 user nova-compute[75292]:   </metadata>
Nov 14 14:57:36 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:57:36 user nova-compute[75292]:     <system>
Nov 14 14:57:36 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:57:36 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:57:36 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:57:36 user nova-compute[75292]:       <entry name="serial">7eae039c-7751-46d6-b4c0-c15dc89a78b9</entry>
Nov 14 14:57:36 user nova-compute[75292]:       <entry name="uuid">7eae039c-7751-46d6-b4c0-c15dc89a78b9</entry>
Nov 14 14:57:36 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:57:36 user nova-compute[75292]:     </system>
Nov 14 14:57:36 user nova-compute[75292]:   </sysinfo>
Nov 14 14:57:36 user nova-compute[75292]:   <os>
Nov 14 14:57:36 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:57:36 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:57:36 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:57:36 user nova-compute[75292]:   </os>
Nov 14 14:57:36 user nova-compute[75292]:   <features>
Nov 14 14:57:36 user nova-compute[75292]:     <acpi/>
Nov 14 14:57:36 user nova-compute[75292]:     <apic/>
Nov 14 14:57:36 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:57:36 user nova-compute[75292]:   </features>
Nov 14 14:57:36 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:57:36 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:57:36 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:57:36 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:57:36 user nova-compute[75292]:   </clock>
Nov 14 14:57:36 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:57:36 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:57:36 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:57:36 user nova-compute[75292]:   </cpu>
Nov 14 14:57:36 user nova-compute[75292]:   <devices>
Nov 14 14:57:36 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:57:36 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:57:36 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk"/>
Nov 14 14:57:36 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:57:36 user nova-compute[75292]:     </disk>
Nov 14 14:57:36 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:57:36 user nova-compute[75292]:       <mac address="fa:16:3e:e9:64:3b"/>
Nov 14 14:57:36 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:57:36 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:57:36 user nova-compute[75292]:       <target dev="tap777f46c6-4a"/>
Nov 14 14:57:36 user nova-compute[75292]:     </interface>
Nov 14 14:57:36 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:57:36 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/console.log" append="off"/>
Nov 14 14:57:36 user nova-compute[75292]:     </serial>
Nov 14 14:57:36 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:57:36 user nova-compute[75292]:     <video>
Nov 14 14:57:36 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:57:36 user nova-compute[75292]:     </video>
Nov 14 14:57:36 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:57:36 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:57:36 user nova-compute[75292]:     </rng>
Nov 14 14:57:36 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:57:36 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:57:36 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:57:36 user nova-compute[75292]:     </memballoon>
Nov 14 14:57:36 user nova-compute[75292]:   </devices>
Nov 14 14:57:36 user nova-compute[75292]: </domain>
Nov 14 14:57:36 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-421272435',display_name='tempest-AttachVolumeNegativeTest-server-421272435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-421272435',id=42,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJHmZXZSRALTnsXGuR7ZPP2CGymAUzjEM1Bw5uD7IIsk2QxRGWwbW1+BRILJ8udvqHNnwAOuixBnyjx9MRehwNtpedghQAaFV+AiBhSRXtbyKu+OUFxTCeaJXEeYbAQdA==',key_name='tempest-keypair-1058922560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-fbyix93c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=7eae039c-7751-46d6-b4c0-c15dc89a78b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG os_vif [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd1fde79-8ee4-585d-bfe2-63fcdbeda021', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap777f46c6-4a, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap777f46c6-4a, col_values=(('qos', UUID('db24cb84-bb1b-49d3-8bdd-f931d68de92e')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap777f46c6-4a, col_values=(('external_ids', {'iface-id': '777f46c6-4a36-4697-89cf-2a8ed6d4bef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:64:3b', 'vm-uuid': '7eae039c-7751-46d6-b4c0-c15dc89a78b9'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:36 user nova-compute[75292]: INFO os_vif [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a')
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:e9:64:3b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updated VIF entry in instance network info cache for port 777f46c6-4a36-4697-89cf-2a8ed6d4bef2. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updating instance_info_cache with network_info: [{"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff40d3fb-7a87-41e6-bd18-9eefb7e72e2c req-9ef2852b-ccda-4769-9097-d49cc4695d3e service nova] Releasing lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:37 user nova-compute[75292]: INFO nova.compute.manager [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Terminating instance
Nov 14 14:57:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-02379b27-186b-4fd0-926d-03c7a53ba0cf req-cd8f6f5a-08d1-4ec2-8414-c2c5380437d5 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-02379b27-186b-4fd0-926d-03c7a53ba0cf req-cd8f6f5a-08d1-4ec2-8414-c2c5380437d5 service nova] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-02379b27-186b-4fd0-926d-03c7a53ba0cf req-cd8f6f5a-08d1-4ec2-8414-c2c5380437d5 service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-02379b27-186b-4fd0-926d-03c7a53ba0cf req-cd8f6f5a-08d1-4ec2-8414-c2c5380437d5 service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-02379b27-186b-4fd0-926d-03c7a53ba0cf req-cd8f6f5a-08d1-4ec2-8414-c2c5380437d5 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] No waiting events found dispatching network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:57:37 user nova-compute[75292]: WARNING nova.compute.manager [req-02379b27-186b-4fd0-926d-03c7a53ba0cf req-cd8f6f5a-08d1-4ec2-8414-c2c5380437d5 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received unexpected event network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 for instance with vm_state building and task_state spawning.
Nov 14 14:57:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-2a993299-ac78-4cc7-9519-00293f2d8812 req-87212751-5115-4c62-b62a-46a72798f17c service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-vif-unplugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2a993299-ac78-4cc7-9519-00293f2d8812 req-87212751-5115-4c62-b62a-46a72798f17c service nova] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2a993299-ac78-4cc7-9519-00293f2d8812 req-87212751-5115-4c62-b62a-46a72798f17c service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-2a993299-ac78-4cc7-9519-00293f2d8812 req-87212751-5115-4c62-b62a-46a72798f17c service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-2a993299-ac78-4cc7-9519-00293f2d8812 req-87212751-5115-4c62-b62a-46a72798f17c service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] No waiting events found dispatching network-vif-unplugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:57:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-2a993299-ac78-4cc7-9519-00293f2d8812 req-87212751-5115-4c62-b62a-46a72798f17c service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-vif-unplugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:57:38 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Instance destroyed successfully.
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.objects.instance [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'resources' on Instance uuid b66c8072-5bdd-4f9d-8828-a691fe539d23 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1747411629',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1747411629',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1747411629',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC145AzLQhOAMxkylITGjNaXYPqICo6hA3jejvF4Lt+kLSUOYUJMJmaNQPIeQ8xtZRcICPmC00kvpa8+YYTQlsiY+1+0ycPRzlt5EfyIML9vYMP3QnTWmHmKGVyO84Vxrw==',key_name='tempest-keypair-372527537',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:53:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-zuchoaw9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:53:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='12846e84377c40998d795e5f0b09252f',uuid=b66c8072-5bdd-4f9d-8828-a691fe539d23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "address": "fa:16:3e:28:5c:32", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8705205c-f3", "ovs_interfaceid": "8705205c-f3e0-4a7e-8e8b-29675e4db47f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_vif [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8705205c-f3, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7982fef2-cb16-42a8-8d3d-f2bcc85ebf0a) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:57:38 user nova-compute[75292]: INFO os_vif [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:5c:32,bridge_name='br-int',has_traffic_filtering=True,id=8705205c-f3e0-4a7e-8e8b-29675e4db47f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8705205c-f3')
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzHiTxBn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:57:38 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a4f0b8-4711-42d8-9647-22219266272e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:57:38 user nova-compute[75292]: No targets found.
Nov 14 14:57:38 user nova-compute[75292]: iSNS:
Nov 14 14:57:38 user nova-compute[75292]: No targets found.
Nov 14 14:57:38 user nova-compute[75292]: STATIC:
Nov 14 14:57:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:57:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:57:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:57:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3
Nov 14 14:57:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:57:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:57:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf
Nov 14 14:57:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:57:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:57:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:57:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:57:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:57:38 user nova-compute[75292]: FIRMWARE:
Nov 14 14:57:38 user nova-compute[75292]: No targets found.
Nov 14 14:57:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:57:38 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:57:38 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e20dda-176e-404f-af30-6000ac18bf4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7004ef33-e1e2-40ce-aaeb-d948e93179ad]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:38 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:38 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:57:38 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:38 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:38 user nova-compute[75292]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 (non-flash)
Nov 14 14:57:38 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542b0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8bee77-e9d5-4419-b96f-54f624a6ed24]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc10ddb2-d057-4a76-8740-97d396a2b95f]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-changed-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Refreshing instance network info cache due to event network-changed-0a6d4cce-e288-4be0-a978-dd4ff32f5173. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] Acquiring lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] Acquired lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.network.neutron [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Refreshing network info cache for port 0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0483ea40-b18f-4ea0-92d5-f86ed012c1ae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b471731-622a-4857-99a3-dabe38604048]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c0d7b-d937-4dc2-a57c-703b2c970938]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c05687-e6c4-42ba-9265-19b7e891cafc]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260]
Nov 14 14:57:38 user nova-compute[75292]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3, portal: 172.16.0.220,3260] successful.
Nov 14 14:57:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4550877-a389-4988-b864-d70c4508d5d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[661367e8-85ea-40f4-9ff4-cf753e9641cd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== disconnect_volume: return (321ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:57:38 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Deleting instance files /opt/stack/data/nova/instances/b66c8072-5bdd-4f9d-8828-a691fe539d23_del
Nov 14 14:57:38 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Deletion of /opt/stack/data/nova/instances/b66c8072-5bdd-4f9d-8828-a691fe539d23_del complete
Nov 14 14:57:38 user nova-compute[75292]: INFO nova.compute.manager [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.network.neutron [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updated VIF entry in instance network info cache for port 0a6d4cce-e288-4be0-a978-dd4ff32f5173. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.network.neutron [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating instance_info_cache with network_info: [{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7a83e3e5-005f-4345-90a4-f381c8399d5a req-663de515-daa4-4c69-8d11-385eb1559e76 service nova] Releasing lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG nova.objects.instance [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'flavor' on Instance uuid 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:39 user nova-compute[75292]: INFO nova.compute.manager [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Attaching volume f81df040-c604-40bc-bcdc-c10a4840bc84 to /dev/vdb
Nov 14 14:57:39 user nova-compute[75292]: DEBUG os_brick.utils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[785a39cc-fe99-4f4b-8459-a5a2263ec3b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b362328f-8f84-4e8f-9d6e-2b9c80e39917]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0c02b8-6267-4fab-9454-0807a405ae9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad934c-cfc9-43aa-88ef-3dd44d373f66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:57:39 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bd74c3-8782-4b9f-8217-d7ca6418adec]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG os_brick.utils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating existing volume attachment record: 97c85502-0566-4a8d-9334-ba8bee52f6d5 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:57:39 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Took 0.98 seconds to deallocate network for instance.
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] No waiting events found dispatching network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:57:39 user nova-compute[75292]: WARNING nova.compute.manager [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received unexpected event network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 for instance with vm_state building and task_state spawning.
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-b97df3e1-2b3a-487f-b6bc-ad8e2627460d req-07bd770a-4dff-478e-837d-22d6841bbf7e service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-vif-deleted-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-f2762106-3df6-43f6-9469-6f753b00b333 req-4231acc0-9305-4953-ad1d-bcb980cee29a service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received event network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f2762106-3df6-43f6-9469-6f753b00b333 req-4231acc0-9305-4953-ad1d-bcb980cee29a service nova] Acquiring lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f2762106-3df6-43f6-9469-6f753b00b333 req-4231acc0-9305-4953-ad1d-bcb980cee29a service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f2762106-3df6-43f6-9469-6f753b00b333 req-4231acc0-9305-4953-ad1d-bcb980cee29a service nova] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-f2762106-3df6-43f6-9469-6f753b00b333 req-4231acc0-9305-4953-ad1d-bcb980cee29a service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] No waiting events found dispatching network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:57:39 user nova-compute[75292]: WARNING nova.compute.manager [req-f2762106-3df6-43f6-9469-6f753b00b333 req-4231acc0-9305-4953-ad1d-bcb980cee29a service nova] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Received unexpected event network-vif-plugged-8705205c-f3e0-4a7e-8e8b-29675e4db47f for instance with vm_state active and task_state deleting.
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:57:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Instance spawned successfully.
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:40 user nova-compute[75292]: INFO nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:57:40 user nova-compute[75292]: INFO nova.compute.manager [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Took 6.29 seconds to build instance.
Nov 14 14:57:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3926b09c-0016-4b34-8d32-b7d889f618cd tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.388s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:40 user nova-compute[75292]: INFO nova.compute.manager [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: b66c8072-5bdd-4f9d-8828-a691fe539d23] Deleting volume: d4550877-a389-4988-b864-d70c4508d5d3 {{(pid=75292) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:57:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:40 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Deleted allocations for instance b66c8072-5bdd-4f9d-8828-a691fe539d23
Nov 14 14:57:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-03b19f09-94ca-40f9-8e36-7a878e64e060 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "b66c8072-5bdd-4f9d-8828-a691fe539d23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.667s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GypHrmEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:57:43 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:57:43 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:57:43 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6e147d-9700-47be-904a-ba16f5383c8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:57:43 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd4a4f-0fa9-481b-bf19-696b6cd3bcfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84] added
Nov 14 14:57:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c277d-7f38-4fb8-9644-f845ef97eff0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e0408-9f0f-4ca1-aace-38cce83d1af6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GypHrmEA {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GypHrmEA" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45eed9b-11a0-4cd6-ac84-7940bad2b086]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GypHrmEA'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ce9d7c-1812-43bb-a451-d9960e49fbfb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[87864c65-82e8-4b54-91e4-db609fd60e79]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:43 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:43 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:43 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:43 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:57:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[85846c79-68f0-40a1-8548-70cb86f089af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260]
Nov 14 14:57:44 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260] successful.
Nov 14 14:57:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[67275d4a-cd7a-4f4d-ac63-90e8130209ee]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e346228-3ad4-4797-ab88-e56dc8b46b99]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:44 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:44 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:44 user nova-compute[75292]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 (non-flash)
Nov 14 14:57:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:57:44 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:57:44 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:57:44 user nova-compute[75292]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 (non-flash)
Nov 14 14:57:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af552d-957f-456e-abff-94d49e14416d]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:57:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GypHrmEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23862613538613361', 'path': '/dev/sde'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862613538613361', 'path': '/dev/sde'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'flavor' on Instance uuid 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:57:45 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:57:45 user nova-compute[75292]:   <source dev="/dev/sde"/>
Nov 14 14:57:45 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:57:45 user nova-compute[75292]:   <serial>f81df040-c604-40bc-bcdc-c10a4840bc84</serial>
Nov 14 14:57:45 user nova-compute[75292]: </disk>
Nov 14 14:57:45 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No VIF found with MAC fa:16:3e:f2:16:10, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:57:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-648a96ea-18a1-41d0-ad18-535ef6db1383 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.588s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:57:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:57:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:57:48 user nova-compute[75292]: INFO nova.compute.manager [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Detaching volume f81df040-c604-40bc-bcdc-c10a4840bc84
Nov 14 14:57:48 user nova-compute[75292]: INFO nova.virt.block_device [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Attempting to driver detach volume f81df040-c604-40bc-bcdc-c10a4840bc84 from mountpoint /dev/vdb
Nov 14 14:57:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Attempting to detach device vdb from instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:57:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:57:48 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:57:48 user nova-compute[75292]:   <source dev="/dev/sde"/>
Nov 14 14:57:48 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:57:48 user nova-compute[75292]:   <serial>f81df040-c604-40bc-bcdc-c10a4840bc84</serial>
Nov 14 14:57:48 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:57:48 user nova-compute[75292]: </disk>
Nov 14 14:57:48 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:57:48 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully detached device vdb from instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 from the persistent domain config.
Nov 14 14:57:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:57:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:57:48 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:57:48 user nova-compute[75292]:   <source dev="/dev/sde"/>
Nov 14 14:57:48 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:57:48 user nova-compute[75292]:   <serial>f81df040-c604-40bc-bcdc-c10a4840bc84</serial>
Nov 14 14:57:48 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:57:48 user nova-compute[75292]: </disk>
Nov 14 14:57:48 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:57:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:57:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:57:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:08 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 is timed out.
Nov 14 14:58:08 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully detached device vdb from instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 from the live domain config.
Nov 14 14:58:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GypHrmEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:58:08 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f8d899-88a0-4c7c-85b2-7ee4b5a31d92]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:58:08 user nova-compute[75292]: No targets found.
Nov 14 14:58:08 user nova-compute[75292]: iSNS:
Nov 14 14:58:08 user nova-compute[75292]: No targets found.
Nov 14 14:58:08 user nova-compute[75292]: STATIC:
Nov 14 14:58:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:58:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf
Nov 14 14:58:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:58:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:08 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84
Nov 14 14:58:08 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:08 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:08 user nova-compute[75292]: FIRMWARE:
Nov 14 14:58:08 user nova-compute[75292]: No targets found.
Nov 14 14:58:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:58:08 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:58:08 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad4507-aa2f-43d4-94a6-1b5fd9c05f89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f4922-1dea-46c6-bef8-5d2981bbd25f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:08 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:58:08 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:08 user nova-compute[75292]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 (non-flash)
Nov 14 14:58:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:08 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:58:08 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:08 user nova-compute[75292]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 (non-flash)
Nov 14 14:58:08 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b781dc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84'): ({'sde'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Removing single pathed devices sde {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515d271-5cbe-49cc-957d-cbeafc7a69c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c61a7-12a6-4133-bf0c-2d4bf554f6eb]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Flushing IO for device /dev/sde {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac73bfa8-ff0b-4e83-aa92-3cb42ed0717b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:58:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa11dc-a1fb-4bac-8fbd-12a8366697ba]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] SCSI volumes sde have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3267a186-b8b1-46a2-ba11-ef5fa50506e9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38e728-79ea-465c-b220-78869344135b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260]
Nov 14 14:58:09 user nova-compute[75292]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84, portal: 172.16.0.220,3260] successful.
Nov 14 14:58:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81df040-c604-40bc-bcdc-c10a4840bc84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7c99b9-7a5d-4987-afd1-3dcb4dcf7646]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] <== disconnect_volume: return (282ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'flavor' on Instance uuid 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:58:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c66da2c7-0558-40e8-a9c8-3f385931ec11 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.562s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:16 user nova-compute[75292]: INFO nova.compute.manager [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Terminating instance
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-e0b43ca5-ae6d-4dac-b351-a23bc61442f2 req-f96561b9-cd48-43b5-ac8b-06ea1147b7db service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e0b43ca5-ae6d-4dac-b351-a23bc61442f2 req-f96561b9-cd48-43b5-ac8b-06ea1147b7db service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e0b43ca5-ae6d-4dac-b351-a23bc61442f2 req-f96561b9-cd48-43b5-ac8b-06ea1147b7db service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e0b43ca5-ae6d-4dac-b351-a23bc61442f2 req-f96561b9-cd48-43b5-ac8b-06ea1147b7db service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-e0b43ca5-ae6d-4dac-b351-a23bc61442f2 req-f96561b9-cd48-43b5-ac8b-06ea1147b7db service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.compute.manager [req-e0b43ca5-ae6d-4dac-b351-a23bc61442f2 req-f96561b9-cd48-43b5-ac8b-06ea1147b7db service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-unplugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Instance destroyed successfully.
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'resources' on Instance uuid adcd9c44-c430-46ea-986d-b4f7b7888122 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1488050270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1488050270',id=36,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:54:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-gyl6gldd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:56:30Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=adcd9c44-c430-46ea-986d-b4f7b7888122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "address": "fa:16:3e:2e:6b:88", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53d5dd99-ff", "ovs_interfaceid": "53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_vif [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53d5dd99-ff, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0a017df-248e-4b0f-a3d8-84836dab1183) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:16 user nova-compute[75292]: INFO os_vif [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:6b:88,bridge_name='br-int',has_traffic_filtering=True,id=53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53d5dd99-ff')
Nov 14 14:58:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sKANaJlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:58:16 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6c558e-cb77-4cd2-b36f-7d5c13e1c155]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:58:16 user nova-compute[75292]: No targets found.
Nov 14 14:58:16 user nova-compute[75292]: iSNS:
Nov 14 14:58:16 user nova-compute[75292]: No targets found.
Nov 14 14:58:16 user nova-compute[75292]: STATIC:
Nov 14 14:58:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:58:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf
Nov 14 14:58:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:16 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9
Nov 14 14:58:16 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:58:16 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:58:16 user nova-compute[75292]: FIRMWARE:
Nov 14 14:58:16 user nova-compute[75292]: No targets found.
Nov 14 14:58:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:58:16 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:58:16 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b812cd-17d6-4d09-abf7-3c1ef91e4a3b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5829d436-0441-4778-89e3-9b011dea8040]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:16 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:58:16 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:16 user nova-compute[75292]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 (non-flash)
Nov 14 14:58:16 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:16 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5419a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[36709aa4-3110-4729-8c52-371d8d19a85c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e08d3-6721-49f8-9acd-d6161c807128]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e239f88f-2545-496d-8e24-b65579c23bf2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:58:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60674df-28f1-4b49-850e-27521449525e]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8323265f', '/dev/disk/by-id/scsi-1SCST_BIO8323265f-cb839a83f58ddacd', '/dev/disk/by-id/scsi-26362383339613833') {{(pid=86373) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ed856-e484-4119-b54b-90d7e93d341d]: (4, None) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[201575e1-ea5e-4052-b632-db3dc72d3d14]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4f7c29-b06d-4c6e-8127-f94fb4156ba5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260]
Nov 14 14:58:17 user nova-compute[75292]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9, portal: 172.16.0.220,3260] successful.
Nov 14 14:58:17 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78c8c620-e8b2-4f4e-b93b-582a8bd791a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2f68dd-6a55-4760-8e42-4763bbbecc78]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== disconnect_volume: return (332ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:58:17 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Deleting instance files /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122_del
Nov 14 14:58:17 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Deletion of /opt/stack/data/nova/instances/adcd9c44-c430-46ea-986d-b4f7b7888122_del complete
Nov 14 14:58:17 user nova-compute[75292]: INFO nova.compute.manager [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 14:58:17 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:58:17 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:58:18 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:58:18 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Took 1.15 seconds to deallocate network for instance.
Nov 14 14:58:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-5058e390-22b3-45b1-8f6b-7007e345609d req-0bc957fe-5221-4a33-bc21-595d43bfd5e5 service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-deleted-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-f43731a4-e715-4af6-95bd-8c79a7c3841c req-8eea818d-72ce-4c02-8ff0-1a3c34c8180d service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f43731a4-e715-4af6-95bd-8c79a7c3841c req-8eea818d-72ce-4c02-8ff0-1a3c34c8180d service nova] Acquiring lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f43731a4-e715-4af6-95bd-8c79a7c3841c req-8eea818d-72ce-4c02-8ff0-1a3c34c8180d service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f43731a4-e715-4af6-95bd-8c79a7c3841c req-8eea818d-72ce-4c02-8ff0-1a3c34c8180d service nova] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:18 user nova-compute[75292]: DEBUG nova.compute.manager [req-f43731a4-e715-4af6-95bd-8c79a7c3841c req-8eea818d-72ce-4c02-8ff0-1a3c34c8180d service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] No waiting events found dispatching network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:58:18 user nova-compute[75292]: WARNING nova.compute.manager [req-f43731a4-e715-4af6-95bd-8c79a7c3841c req-8eea818d-72ce-4c02-8ff0-1a3c34c8180d service nova] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Received unexpected event network-vif-plugged-53d5dd99-ff2d-4d56-bc03-c4660dc0e2e2 for instance with vm_state active and task_state deleting.
Nov 14 14:58:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:19 user nova-compute[75292]: INFO nova.compute.manager [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: adcd9c44-c430-46ea-986d-b4f7b7888122] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 14:58:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:19 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Deleted allocations for instance adcd9c44-c430-46ea-986d-b4f7b7888122
Nov 14 14:58:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f796ab43-c6a5-4754-9951-b75111132bdb tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "adcd9c44-c430-46ea-986d-b4f7b7888122" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.477s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:58:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 14:58:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:58:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:27 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:58:30 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:58:30 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=25.012775421142578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance c4450564-68bb-4ee9-ab0b-9100ce602a46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:58:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.328s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:58:34 user nova-compute[75292]: INFO nova.compute.claims [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Claim successful on node user
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:58:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.policy [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12846e84377c40998d795e5f0b09252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebd367820b4847b1f8b7c402a22ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:58:35 user nova-compute[75292]: INFO nova.virt.block_device [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Booting with volume 15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a at /dev/vda
Nov 14 14:58:35 user nova-compute[75292]: DEBUG os_brick.utils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2439eaa3-233b-4039-9144-2ed6179e0cec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc90947c-c3cc-4f0b-9a91-3ba3cd10a8fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d8b2c-2d90-4278-9f18-490d4591b004]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1557744f-2110-4271-b3a0-e3bc6f8814e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:58:35 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:58:35 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbcffb-9926-4047-a06a-c40d665ae96e]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG os_brick.utils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:58:35 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updating existing volume attachment record: 3b6d3562-32b8-4654-a456-3d98ba6dc5d1 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Successfully created port: ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Successfully updated port: ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquired lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-changed-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Refreshing instance network info cache due to event network-changed-ac4bab6e-04cd-418a-9604-5b751e26afd1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] Acquiring lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updating instance_info_cache with network_info: [{"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Releasing lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Instance network_info: |[{"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] Acquired lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:58:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Refreshing network info cache for port ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:58:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updated VIF entry in instance network info cache for port ac4bab6e-04cd-418a-9604-5b751e26afd1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:58:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updating instance_info_cache with network_info: [{"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:58:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5d37e128-b3e9-4c4a-ae16-601da4a48cc1 req-08e275e4-106e-44ac-a234-070dd36d30b6 service nova] Releasing lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:58:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Creating image(s)
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Ensure instance console log exists: /opt/stack/data/nova/instances/a0ec539c-cd6c-4745-9509-c2654d9eaaa1/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Start _get_guest_xml network_info=[{"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3b6d3562-32b8-4654-a456-3d98ba6dc5d1', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a0ec539c-cd6c-4745-9509-c2654d9eaaa1', 'attached_at': '', 'detached_at': '', 'volume_id': '15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'serial': '15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:58:40 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:58:40 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:58:40 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:58:40 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:58:40 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e64689-8d11-4e23-bdcc-bb2951005e85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:58:40 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2020e57-11e5-49f9-a767-89107edb6c10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a] added
Nov 14 14:58:40 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bfb8bf-af8e-45a5-ba77-f9dcb9e8ef9b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00344e2-53c1-4ee0-922e-9a6a69cfcf87]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVopBxEW {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVopBxEW" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0597704a-faa1-475b-854b-0e693f3aba49]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kVopBxEW'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c292caa-3ca3-4959-9ea2-8dd72deea0e1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f2cc2a-85da-4831-a20f-45cfdcac0a24]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:40 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:40 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:40 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:40 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa44543-fbe3-4e16-ad28-36b9301eca53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]
Nov 14 14:58:40 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.
Nov 14 14:58:40 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a6a453-bedd-474c-a71c-f2685a1fafdb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b5266-cb16-41e5-bb55-c90889eb38cf]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:40 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:40 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:58:40 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:58:40 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:58:40 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:58:40 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64376f6-a2ef-4bce-a372-dad4375eb49e]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:58:40 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:58:40 user nova-compute[75292]: INFO nova.compute.manager [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] instance snapshotting
Nov 14 14:58:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Beginning live snapshot process
Nov 14 14:58:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json -f qcow2 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_qh0i6j0/00155a43d0d749f7a6e68ec4d8511969.delta 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_qh0i6j0/00155a43d0d749f7a6e68ec4d8511969.delta 1073741824" returned: 0 in 0.046s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 14:58:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23430666136323666', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430666136323666', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1081642560',display_name='tempest-TestVolumeBootPattern-server-1081642560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1081642560',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-tw014m0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:58:35Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=a0ec539c-cd6c-4745-9509-c2654d9eaaa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'pci_devices' on Instance uuid a0ec539c-cd6c-4745-9509-c2654d9eaaa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:58:41 user nova-compute[75292]:   <uuid>a0ec539c-cd6c-4745-9509-c2654d9eaaa1</uuid>
Nov 14 14:58:41 user nova-compute[75292]:   <name>instance-0000002b</name>
Nov 14 14:58:41 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:58:41 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:58:41 user nova-compute[75292]:   <metadata>
Nov 14 14:58:41 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:58:41 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:58:41 user nova-compute[75292]:       <nova:name>tempest-TestVolumeBootPattern-server-1081642560</nova:name>
Nov 14 14:58:41 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:58:40</nova:creationTime>
Nov 14 14:58:41 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:58:41 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:58:41 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:58:41 user nova-compute[75292]:       <nova:owner>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:user uuid="12846e84377c40998d795e5f0b09252f">tempest-TestVolumeBootPattern-53606599-project-member</nova:user>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:project uuid="6cebd367820b4847b1f8b7c402a22ffc">tempest-TestVolumeBootPattern-53606599</nova:project>
Nov 14 14:58:41 user nova-compute[75292]:       </nova:owner>
Nov 14 14:58:41 user nova-compute[75292]:       <nova:ports>
Nov 14 14:58:41 user nova-compute[75292]:         <nova:port uuid="ac4bab6e-04cd-418a-9604-5b751e26afd1">
Nov 14 14:58:41 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 14:58:41 user nova-compute[75292]:         </nova:port>
Nov 14 14:58:41 user nova-compute[75292]:       </nova:ports>
Nov 14 14:58:41 user nova-compute[75292]:     </nova:instance>
Nov 14 14:58:41 user nova-compute[75292]:   </metadata>
Nov 14 14:58:41 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:58:41 user nova-compute[75292]:     <system>
Nov 14 14:58:41 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:58:41 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:58:41 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:58:41 user nova-compute[75292]:       <entry name="serial">a0ec539c-cd6c-4745-9509-c2654d9eaaa1</entry>
Nov 14 14:58:41 user nova-compute[75292]:       <entry name="uuid">a0ec539c-cd6c-4745-9509-c2654d9eaaa1</entry>
Nov 14 14:58:41 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:58:41 user nova-compute[75292]:     </system>
Nov 14 14:58:41 user nova-compute[75292]:   </sysinfo>
Nov 14 14:58:41 user nova-compute[75292]:   <os>
Nov 14 14:58:41 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:58:41 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:58:41 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:58:41 user nova-compute[75292]:   </os>
Nov 14 14:58:41 user nova-compute[75292]:   <features>
Nov 14 14:58:41 user nova-compute[75292]:     <acpi/>
Nov 14 14:58:41 user nova-compute[75292]:     <apic/>
Nov 14 14:58:41 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:58:41 user nova-compute[75292]:   </features>
Nov 14 14:58:41 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:58:41 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:58:41 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:58:41 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:58:41 user nova-compute[75292]:   </clock>
Nov 14 14:58:41 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:58:41 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:58:41 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:58:41 user nova-compute[75292]:   </cpu>
Nov 14 14:58:41 user nova-compute[75292]:   <devices>
Nov 14 14:58:41 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 14:58:41 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:58:41 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 14:58:41 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:58:41 user nova-compute[75292]:       <serial>15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a</serial>
Nov 14 14:58:41 user nova-compute[75292]:     </disk>
Nov 14 14:58:41 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:58:41 user nova-compute[75292]:       <mac address="fa:16:3e:dd:89:a1"/>
Nov 14 14:58:41 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:58:41 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:58:41 user nova-compute[75292]:       <target dev="tapac4bab6e-04"/>
Nov 14 14:58:41 user nova-compute[75292]:     </interface>
Nov 14 14:58:41 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:58:41 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/a0ec539c-cd6c-4745-9509-c2654d9eaaa1/console.log" append="off"/>
Nov 14 14:58:41 user nova-compute[75292]:     </serial>
Nov 14 14:58:41 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:58:41 user nova-compute[75292]:     <video>
Nov 14 14:58:41 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:58:41 user nova-compute[75292]:     </video>
Nov 14 14:58:41 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:58:41 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:58:41 user nova-compute[75292]:     </rng>
Nov 14 14:58:41 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:58:41 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:58:41 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:58:41 user nova-compute[75292]:     </memballoon>
Nov 14 14:58:41 user nova-compute[75292]:   </devices>
Nov 14 14:58:41 user nova-compute[75292]: </domain>
Nov 14 14:58:41 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1081642560',display_name='tempest-TestVolumeBootPattern-server-1081642560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1081642560',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-tw014m0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:58:35Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=a0ec539c-cd6c-4745-9509-c2654d9eaaa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG os_vif [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b5db73a-4b02-5c86-aa3b-87aacc2ab52f', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac4bab6e-04, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac4bab6e-04, col_values=(('qos', UUID('a5caaac7-ca0e-46a0-9636-921021a610f7')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac4bab6e-04, col_values=(('external_ids', {'iface-id': 'ac4bab6e-04cd-418a-9604-5b751e26afd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:89:a1', 'vm-uuid': 'a0ec539c-cd6c-4745-9509-c2654d9eaaa1'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:41 user nova-compute[75292]: INFO os_vif [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04')
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:58:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No VIF found with MAC fa:16:3e:dd:89:a1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:58:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:58:42 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75292) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 14:58:42 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 14:58:43 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_qh0i6j0/00155a43d0d749f7a6e68ec4d8511969.delta /opt/stack/data/nova/instances/snapshots/tmp_qh0i6j0/00155a43d0d749f7a6e68ec4d8511969 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-07cf3452-074a-4b4d-9dd2-9ce8b73c7c63 req-256be02c-aa7c-4ea4-8207-6be054268d6d service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07cf3452-074a-4b4d-9dd2-9ce8b73c7c63 req-256be02c-aa7c-4ea4-8207-6be054268d6d service nova] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07cf3452-074a-4b4d-9dd2-9ce8b73c7c63 req-256be02c-aa7c-4ea4-8207-6be054268d6d service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07cf3452-074a-4b4d-9dd2-9ce8b73c7c63 req-256be02c-aa7c-4ea4-8207-6be054268d6d service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-07cf3452-074a-4b4d-9dd2-9ce8b73c7c63 req-256be02c-aa7c-4ea4-8207-6be054268d6d service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] No waiting events found dispatching network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:58:43 user nova-compute[75292]: WARNING nova.compute.manager [req-07cf3452-074a-4b4d-9dd2-9ce8b73c7c63 req-256be02c-aa7c-4ea4-8207-6be054268d6d service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received unexpected event network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 for instance with vm_state building and task_state spawning.
Nov 14 14:58:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_qh0i6j0/00155a43d0d749f7a6e68ec4d8511969.delta /opt/stack/data/nova/instances/snapshots/tmp_qh0i6j0/00155a43d0d749f7a6e68ec4d8511969" returned: 0 in 0.636s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Snapshot extracted, beginning image upload
Nov 14 14:58:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:58:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Instance spawned successfully.
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-981a3ec3-4d38-4d7b-8071-9a2d755e1dc0 req-d1608a40-e325-4c55-9c94-653495576bce service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-981a3ec3-4d38-4d7b-8071-9a2d755e1dc0 req-d1608a40-e325-4c55-9c94-653495576bce service nova] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-981a3ec3-4d38-4d7b-8071-9a2d755e1dc0 req-d1608a40-e325-4c55-9c94-653495576bce service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-981a3ec3-4d38-4d7b-8071-9a2d755e1dc0 req-d1608a40-e325-4c55-9c94-653495576bce service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.compute.manager [req-981a3ec3-4d38-4d7b-8071-9a2d755e1dc0 req-d1608a40-e325-4c55-9c94-653495576bce service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] No waiting events found dispatching network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:58:45 user nova-compute[75292]: WARNING nova.compute.manager [req-981a3ec3-4d38-4d7b-8071-9a2d755e1dc0 req-d1608a40-e325-4c55-9c94-653495576bce service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received unexpected event network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 for instance with vm_state building and task_state spawning.
Nov 14 14:58:45 user nova-compute[75292]: INFO nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 14 14:58:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:58:45 user nova-compute[75292]: INFO nova.compute.manager [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Took 10.84 seconds to build instance.
Nov 14 14:58:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e947c561-d3e6-495d-9d65-38b498748626 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.941s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:46 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Snapshot image upload complete
Nov 14 14:58:46 user nova-compute[75292]: INFO nova.compute.manager [None req-e5af6f21-72e6-4651-87cd-52b300164860 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Took 5.37 seconds to snapshot the instance on the hypervisor.
Nov 14 14:58:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 14:58:48 user nova-compute[75292]: INFO nova.compute.claims [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Claim successful on node user
Nov 14 14:58:48 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG nova.network.neutron [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 14:58:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 14:58:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG nova.policy [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '480acd7147c34f58b39676cc2ec82397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b370479854d4135964bb1c3af954e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 14:58:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Creating image(s)
Nov 14 14:58:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "/opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "/opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "/opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "89f87aebec2dfb5ad40ce739dc20902e5656a61e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "89f87aebec2dfb5ad40ce739dc20902e5656a61e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG nova.network.neutron [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Successfully created port: fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.part --force-share --output=json" returned: 0 in 0.260s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG nova.virt.images [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] 34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.part /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:50 user nova-compute[75292]: INFO nova.compute.manager [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Detaching volume edc5c9ee-aa49-4f6a-881d-37c2f9a905cf
Nov 14 14:58:51 user nova-compute[75292]: INFO nova.virt.block_device [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Attempting to driver detach volume edc5c9ee-aa49-4f6a-881d-37c2f9a905cf from mountpoint /dev/vdc
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Attempting to detach device vdc from instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:58:51 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:58:51 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:58:51 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 14:58:51 user nova-compute[75292]:   <serial>edc5c9ee-aa49-4f6a-881d-37c2f9a905cf</serial>
Nov 14 14:58:51 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 14:58:51 user nova-compute[75292]: </disk>
Nov 14 14:58:51 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:58:51 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully detached device vdc from instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 from the persistent domain config.
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:58:51 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:58:51 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:58:51 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 14:58:51 user nova-compute[75292]:   <serial>edc5c9ee-aa49-4f6a-881d-37c2f9a905cf</serial>
Nov 14 14:58:51 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 14:58:51 user nova-compute[75292]: </disk>
Nov 14 14:58:51 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.part /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.converted" returned: 0 in 0.851s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Successfully updated port: fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquired lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-changed-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Refreshing instance network info cache due to event network-changed-fae0661b-7e74-41ad-b544-59c26792f6cd. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] Acquiring lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "89f87aebec2dfb5ad40ce739dc20902e5656a61e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.589s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:51 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "89f87aebec2dfb5ad40ce739dc20902e5656a61e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "89f87aebec2dfb5ad40ce739dc20902e5656a61e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.neutron [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating instance_info_cache with network_info: [{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Releasing lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Instance network_info: |[{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] Acquired lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Refreshing network info cache for port fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e,backing_fmt=raw /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e,backing_fmt=raw /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk 1073741824" returned: 0 in 0.057s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "89f87aebec2dfb5ad40ce739dc20902e5656a61e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Ensure instance console log exists: /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Start _get_guest_xml network_info=[{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='88dd85f6a11dc16cf238dea3689b7a7d',container_format='bare',created_at=2023-11-14T14:58:40Z,direct_url=<?>,disk_format='qcow2',id=34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-234814632',owner='0b370479854d4135964bb1c3af954e96',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T14:58:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 14:58:52 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:58:52 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='88dd85f6a11dc16cf238dea3689b7a7d',container_format='bare',created_at=2023-11-14T14:58:40Z,direct_url=<?>,disk_format='qcow2',id=34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-234814632',owner='0b370479854d4135964bb1c3af954e96',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T14:58:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-788107834',display_name='tempest-TestStampPattern-server-788107834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-788107834',id=44,image_ref='34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4X0bZ2E6lTaWCurq+vNQ7Eay1a1PgR3+amBQH2b8b5jqS2H83E4VO6gRrOd1s0X09OzYJn0hNdn8zkkqzW1XjZt3CYTTnX+OOgkotOanJ2EWGZB8tKp2PnXsl8eozlw==',key_name='tempest-TestStampPattern-2124283914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b370479854d4135964bb1c3af954e96',ramdisk_id='',reservation_id='r-wkp9lpwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9b1e65d4-38d6-4959-8dda-40d33b83a895',image_min_disk='1',image_min_ram='0',image_owner_id='0b370479854d4135964bb1c3af954e96',image_owner_project_name='tempest-TestStampPattern-2069546202',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2069546202-project-member',image_user_id='480acd7147c34f58b39676cc2ec82397',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069546202',owner_user_name='tempest-TestStampPattern-2069546202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:58:49Z,user_data=None,user_id='480acd7147c34f58b39676cc2ec82397',uuid=72f698e5-c358-4a02-96f5-993a91ab969d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converting VIF {"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.objects.instance [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'pci_devices' on Instance uuid 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 14:58:52 user nova-compute[75292]:   <uuid>72f698e5-c358-4a02-96f5-993a91ab969d</uuid>
Nov 14 14:58:52 user nova-compute[75292]:   <name>instance-0000002c</name>
Nov 14 14:58:52 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 14:58:52 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 14:58:52 user nova-compute[75292]:   <metadata>
Nov 14 14:58:52 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 14:58:52 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 14:58:52 user nova-compute[75292]:       <nova:name>tempest-TestStampPattern-server-788107834</nova:name>
Nov 14 14:58:52 user nova-compute[75292]:       <nova:creationTime>2023-11-14 14:58:52</nova:creationTime>
Nov 14 14:58:52 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 14:58:52 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 14:58:52 user nova-compute[75292]:       </nova:flavor>
Nov 14 14:58:52 user nova-compute[75292]:       <nova:owner>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:user uuid="480acd7147c34f58b39676cc2ec82397">tempest-TestStampPattern-2069546202-project-member</nova:user>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:project uuid="0b370479854d4135964bb1c3af954e96">tempest-TestStampPattern-2069546202</nova:project>
Nov 14 14:58:52 user nova-compute[75292]:       </nova:owner>
Nov 14 14:58:52 user nova-compute[75292]:       <nova:root type="image" uuid="34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe"/>
Nov 14 14:58:52 user nova-compute[75292]:       <nova:ports>
Nov 14 14:58:52 user nova-compute[75292]:         <nova:port uuid="fae0661b-7e74-41ad-b544-59c26792f6cd">
Nov 14 14:58:52 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 14:58:52 user nova-compute[75292]:         </nova:port>
Nov 14 14:58:52 user nova-compute[75292]:       </nova:ports>
Nov 14 14:58:52 user nova-compute[75292]:     </nova:instance>
Nov 14 14:58:52 user nova-compute[75292]:   </metadata>
Nov 14 14:58:52 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 14:58:52 user nova-compute[75292]:     <system>
Nov 14 14:58:52 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 14:58:52 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 14:58:52 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 14:58:52 user nova-compute[75292]:       <entry name="serial">72f698e5-c358-4a02-96f5-993a91ab969d</entry>
Nov 14 14:58:52 user nova-compute[75292]:       <entry name="uuid">72f698e5-c358-4a02-96f5-993a91ab969d</entry>
Nov 14 14:58:52 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 14:58:52 user nova-compute[75292]:     </system>
Nov 14 14:58:52 user nova-compute[75292]:   </sysinfo>
Nov 14 14:58:52 user nova-compute[75292]:   <os>
Nov 14 14:58:52 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 14:58:52 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 14:58:52 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 14:58:52 user nova-compute[75292]:   </os>
Nov 14 14:58:52 user nova-compute[75292]:   <features>
Nov 14 14:58:52 user nova-compute[75292]:     <acpi/>
Nov 14 14:58:52 user nova-compute[75292]:     <apic/>
Nov 14 14:58:52 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 14:58:52 user nova-compute[75292]:   </features>
Nov 14 14:58:52 user nova-compute[75292]:   <clock offset="utc">
Nov 14 14:58:52 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 14:58:52 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 14:58:52 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 14:58:52 user nova-compute[75292]:   </clock>
Nov 14 14:58:52 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 14:58:52 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 14:58:52 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 14:58:52 user nova-compute[75292]:   </cpu>
Nov 14 14:58:52 user nova-compute[75292]:   <devices>
Nov 14 14:58:52 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 14:58:52 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 14:58:52 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk"/>
Nov 14 14:58:52 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 14:58:52 user nova-compute[75292]:     </disk>
Nov 14 14:58:52 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 14:58:52 user nova-compute[75292]:       <mac address="fa:16:3e:aa:8b:5e"/>
Nov 14 14:58:52 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:58:52 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 14:58:52 user nova-compute[75292]:       <target dev="tapfae0661b-7e"/>
Nov 14 14:58:52 user nova-compute[75292]:     </interface>
Nov 14 14:58:52 user nova-compute[75292]:     <serial type="pty">
Nov 14 14:58:52 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/console.log" append="off"/>
Nov 14 14:58:52 user nova-compute[75292]:     </serial>
Nov 14 14:58:52 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 14:58:52 user nova-compute[75292]:     <video>
Nov 14 14:58:52 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 14:58:52 user nova-compute[75292]:     </video>
Nov 14 14:58:52 user nova-compute[75292]:     <rng model="virtio">
Nov 14 14:58:52 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 14:58:52 user nova-compute[75292]:     </rng>
Nov 14 14:58:52 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 14:58:52 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 14:58:52 user nova-compute[75292]:       <stats period="10"/>
Nov 14 14:58:52 user nova-compute[75292]:     </memballoon>
Nov 14 14:58:52 user nova-compute[75292]:   </devices>
Nov 14 14:58:52 user nova-compute[75292]: </domain>
Nov 14 14:58:52 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-788107834',display_name='tempest-TestStampPattern-server-788107834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-788107834',id=44,image_ref='34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4X0bZ2E6lTaWCurq+vNQ7Eay1a1PgR3+amBQH2b8b5jqS2H83E4VO6gRrOd1s0X09OzYJn0hNdn8zkkqzW1XjZt3CYTTnX+OOgkotOanJ2EWGZB8tKp2PnXsl8eozlw==',key_name='tempest-TestStampPattern-2124283914',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b370479854d4135964bb1c3af954e96',ramdisk_id='',reservation_id='r-wkp9lpwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9b1e65d4-38d6-4959-8dda-40d33b83a895',image_min_disk='1',image_min_ram='0',image_owner_id='0b370479854d4135964bb1c3af954e96',image_owner_project_name='tempest-TestStampPattern-2069546202',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2069546202-project-member',image_user_id='480acd7147c34f58b39676cc2ec82397',network_allocated='True',owner_project_name='tempest-TestStampPattern-2069546202',owner_user_name='tempest-TestStampPattern-2069546202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T14:58:49Z,user_data=None,user_id='480acd7147c34f58b39676cc2ec82397',uuid=72f698e5-c358-4a02-96f5-993a91ab969d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converting VIF {"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG os_vif [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfb2c4a1-45ff-5bce-8fe3-8e477cc40c73', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfae0661b-7e, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfae0661b-7e, col_values=(('qos', UUID('70af34df-fae1-4f9e-bfd9-9bc3af8c799a')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfae0661b-7e, col_values=(('external_ids', {'iface-id': 'fae0661b-7e74-41ad-b544-59c26792f6cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:8b:5e', 'vm-uuid': '72f698e5-c358-4a02-96f5-993a91ab969d'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:52 user nova-compute[75292]: INFO os_vif [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e')
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No VIF found with MAC fa:16:3e:aa:8b:5e, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updated VIF entry in instance network info cache for port fae0661b-7e74-41ad-b544-59c26792f6cd. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating instance_info_cache with network_info: [{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:58:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e809679a-ee2e-4588-95f5-9d53989392b6 req-9f8bd78e-46dc-46ae-bbf1-fc4b2ef196aa service nova] Releasing lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:58:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-37f0d6b7-b959-4959-a2dc-5f379184201c req-f7b76a9f-0b97-4be2-bf25-aae3b69affa4 service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37f0d6b7-b959-4959-a2dc-5f379184201c req-f7b76a9f-0b97-4be2-bf25-aae3b69affa4 service nova] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37f0d6b7-b959-4959-a2dc-5f379184201c req-f7b76a9f-0b97-4be2-bf25-aae3b69affa4 service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37f0d6b7-b959-4959-a2dc-5f379184201c req-f7b76a9f-0b97-4be2-bf25-aae3b69affa4 service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-37f0d6b7-b959-4959-a2dc-5f379184201c req-f7b76a9f-0b97-4be2-bf25-aae3b69affa4 service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] No waiting events found dispatching network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:58:54 user nova-compute[75292]: WARNING nova.compute.manager [req-37f0d6b7-b959-4959-a2dc-5f379184201c req-f7b76a9f-0b97-4be2-bf25-aae3b69affa4 service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received unexpected event network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd for instance with vm_state building and task_state spawning.
Nov 14 14:58:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:58:55 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 14:58:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 14:58:55 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Instance spawned successfully.
Nov 14 14:58:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 14:58:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 14:58:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1578f6a-c887-4f23-a62e-3e2a2b98b656 req-467278e7-c041-4705-98a7-c43a41db6d3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:58:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1578f6a-c887-4f23-a62e-3e2a2b98b656 req-467278e7-c041-4705-98a7-c43a41db6d3c service nova] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:58:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1578f6a-c887-4f23-a62e-3e2a2b98b656 req-467278e7-c041-4705-98a7-c43a41db6d3c service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:58:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c1578f6a-c887-4f23-a62e-3e2a2b98b656 req-467278e7-c041-4705-98a7-c43a41db6d3c service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-c1578f6a-c887-4f23-a62e-3e2a2b98b656 req-467278e7-c041-4705-98a7-c43a41db6d3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] No waiting events found dispatching network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:58:56 user nova-compute[75292]: WARNING nova.compute.manager [req-c1578f6a-c887-4f23-a62e-3e2a2b98b656 req-467278e7-c041-4705-98a7-c43a41db6d3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received unexpected event network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd for instance with vm_state building and task_state spawning.
Nov 14 14:58:56 user nova-compute[75292]: INFO nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Took 6.93 seconds to spawn the instance on the hypervisor.
Nov 14 14:58:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 14:58:56 user nova-compute[75292]: INFO nova.compute.manager [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Took 7.64 seconds to build instance.
Nov 14 14:58:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-18bb13d7-0f86-468b-a01e-20bd175af43c tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.754s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:58:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:06 user nova-compute[75292]: INFO nova.compute.manager [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Terminating instance
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff99ebd0-4f1f-47c8-b392-753e1a70f1f3 req-a895a816-88dd-4d06-ba30-20014c1f824f service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-vif-unplugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff99ebd0-4f1f-47c8-b392-753e1a70f1f3 req-a895a816-88dd-4d06-ba30-20014c1f824f service nova] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff99ebd0-4f1f-47c8-b392-753e1a70f1f3 req-a895a816-88dd-4d06-ba30-20014c1f824f service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ff99ebd0-4f1f-47c8-b392-753e1a70f1f3 req-a895a816-88dd-4d06-ba30-20014c1f824f service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff99ebd0-4f1f-47c8-b392-753e1a70f1f3 req-a895a816-88dd-4d06-ba30-20014c1f824f service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] No waiting events found dispatching network-vif-unplugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-ff99ebd0-4f1f-47c8-b392-753e1a70f1f3 req-a895a816-88dd-4d06-ba30-20014c1f824f service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-vif-unplugged-1d0296bc-073f-4a13-b323-274fee9ee9be for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Instance destroyed successfully.
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'resources' on Instance uuid c4450564-68bb-4ee9-ab0b-9100ce602a46 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2099610150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2099610150',id=32,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:49:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-4zh2wakt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:51:42Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=c4450564-68bb-4ee9-ab0b-9100ce602a46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "1d0296bc-073f-4a13-b323-274fee9ee9be", "address": "fa:16:3e:84:41:da", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d0296bc-07", "ovs_interfaceid": "1d0296bc-073f-4a13-b323-274fee9ee9be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG os_vif [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d0296bc-07, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a4b250b-1323-49df-ae63-4f343cd78e39) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:07 user nova-compute[75292]: INFO os_vif [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:41:da,bridge_name='br-int',has_traffic_filtering=True,id=1d0296bc-073f-4a13-b323-274fee9ee9be,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d0296bc-07')
Nov 14 14:59:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Deleting instance files /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46_del
Nov 14 14:59:07 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Deletion of /opt/stack/data/nova/instances/c4450564-68bb-4ee9-ab0b-9100ce602a46_del complete
Nov 14 14:59:07 user nova-compute[75292]: INFO nova.compute.manager [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 14:59:07 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:59:07 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:59:08 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:59:08 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Took 0.54 seconds to deallocate network for instance.
Nov 14 14:59:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:08 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:59:08 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:59:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:08 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Deleted allocations for instance c4450564-68bb-4ee9-ab0b-9100ce602a46
Nov 14 14:59:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d08e4ce0-0f37-4312-a3dd-ae0d1e5acd68 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.833s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] Acquiring lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] Lock "c4450564-68bb-4ee9-ab0b-9100ce602a46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] No waiting events found dispatching network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:59:09 user nova-compute[75292]: WARNING nova.compute.manager [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received unexpected event network-vif-plugged-1d0296bc-073f-4a13-b323-274fee9ee9be for instance with vm_state deleted and task_state None.
Nov 14 14:59:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-96081a89-e908-4224-80d2-8faeaff5d8f5 req-7995614c-6a1d-4f04-a11f-515e1e8f61bb service nova] [instance: c4450564-68bb-4ee9-ab0b-9100ce602a46] Received event network-vif-deleted-1d0296bc-073f-4a13-b323-274fee9ee9be {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:11 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 is timed out.
Nov 14 14:59:11 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully detached device vdc from instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 from the live domain config.
Nov 14 14:59:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cIQYNntH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:59:11 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c540c95d-6660-42ee-9454-1fd21226a61c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:59:11 user nova-compute[75292]: No targets found.
Nov 14 14:59:11 user nova-compute[75292]: iSNS:
Nov 14 14:59:11 user nova-compute[75292]: No targets found.
Nov 14 14:59:11 user nova-compute[75292]: STATIC:
Nov 14 14:59:11 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:59:11 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:11 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:11 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf
Nov 14 14:59:11 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:11 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:11 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 14:59:11 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:11 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:11 user nova-compute[75292]: FIRMWARE:
Nov 14 14:59:11 user nova-compute[75292]: No targets found.
Nov 14 14:59:11 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:59:11 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:59:11 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cf8397-0665-4e8c-b39b-92d1995ead2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c9156-f154-4d01-bfd5-840eedc2ae9c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:11 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:59:11 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:11 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:11 user nova-compute[75292]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf (non-flash)
Nov 14 14:59:11 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:11 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542c0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6683f5c-cf49-4c7e-ae47-fd9ea9602cea]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb20034-e569-4477-a780-6b5d31757e72]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1dd4a-d9d1-46bb-a2c8-c0b1f4fab6ae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e673ce-bacd-4f97-b16e-8a3f59cafbde]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6747af13-6f9b-459d-912b-df7a691fe9e6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:11 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb1ccfb-b727-44f9-bed1-07d74e240325]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260]
Nov 14 14:59:12 user nova-compute[75292]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf, portal: 172.16.0.220,3260] successful.
Nov 14 14:59:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edc5c9ee-aa49-4f6a-881d-37c2f9a905cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02795b-d0f6-4170-966b-6d6a679d57dd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] <== disconnect_volume: return (276ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG nova.objects.instance [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'flavor' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-9a9f8b15-58f9-419b-9104-f67444504301 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.996s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:19 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 14:59:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid a8a94376-8ca1-4e3d-84b5-e597543f7ce4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updating instance_info_cache with network_info: [{"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-a8a94376-8ca1-4e3d-84b5-e597543f7ce4" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:59:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 14:59:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:22 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-changed-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Refreshing instance network info cache due to event network-changed-777f46c6-4a36-4697-89cf-2a8ed6d4bef2. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 14:59:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] Acquiring lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 14:59:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] Acquired lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 14:59:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Refreshing network info cache for port 777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 14:59:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:25 user nova-compute[75292]: DEBUG nova.network.neutron [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updated VIF entry in instance network info cache for port 777f46c6-4a36-4697-89cf-2a8ed6d4bef2. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 14:59:25 user nova-compute[75292]: DEBUG nova.network.neutron [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updating instance_info_cache with network_info: [{"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:59:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-69e1da98-2be3-4900-a627-6dcabb1ea8fc req-4279e7e8-0da8-4f14-8d30-e9e68b89744c service nova] Releasing lock "refresh_cache-7eae039c-7751-46d6-b4c0-c15dc89a78b9" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 14:59:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG nova.objects.instance [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:26 user nova-compute[75292]: INFO nova.compute.manager [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Attaching volume 290f8aba-59cb-4196-ad78-0acd19530ca0 to /dev/vdb
Nov 14 14:59:26 user nova-compute[75292]: DEBUG os_brick.utils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abe8d62-bb5d-402c-8f57-89e13abaeff7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[152ad14e-6488-43c8-b551-ef19237fbf3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c1d8e-b169-4907-b36e-11137ebd56ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ea6f89-7398-43a1-9b13-339c4825aa32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 14:59:26 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 14:59:26 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7bc9e8-e581-4afc-a2fd-ed79c40e0ee5]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG os_brick.utils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:59:26 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updating existing volume attachment record: 3ff631b8-09c7-47fc-a4f2-d0c14c66b166 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 14:59:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 14:59:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:29 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRePGksl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:59:31 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:59:31 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:59:31 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85feac8-7df7-4c6c-95fe-a805f481a9be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 14:59:31 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471a768-c40f-4643-a9e7-26ad1aaf25cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0] added
Nov 14 14:59:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3ffdd-831d-43b3-822d-832145f52c07]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eaacc4-fc2d-49b7-ad8d-1e00210b241f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRePGksl {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRePGksl" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0815a3-ce99-4247-85df-97a2060111ed]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRePGksl'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0354095-6070-4427-bc7c-49f330c777c1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[904e9dd8-ad64-463b-8277-5022c463066e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:31 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:31 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[57884c4e-9b44-4566-8ffe-e7025129dced]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260]
Nov 14 14:59:31 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260] successful.
Nov 14 14:59:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dec47d-67fd-4c93-85ab-fbb322727a6c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[856556d2-fcb4-443b-9bc2-5aaf284ee4b7]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:31 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:31 user nova-compute[75292]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 (non-flash)
Nov 14 14:59:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:31 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:31 user nova-compute[75292]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 (non-flash)
Nov 14 14:59:31 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e92f4f4-e9bc-4450-aeaa-2b230a7e6e2d]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:59:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 14:59:32 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:59:32 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=24.99011993408203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRePGksl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23637653862353632', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637653862353632', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.objects.instance [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 14:59:32 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:59:32 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:59:32 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:59:32 user nova-compute[75292]:   <serial>290f8aba-59cb-4196-ad78-0acd19530ca0</serial>
Nov 14 14:59:32 user nova-compute[75292]: </disk>
Nov 14 14:59:32 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 5399567a-14b0-42ce-9fe0-b0fb74249b85 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ed79b252-324c-461d-bd4b-bc379d1a1bb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a0ec539c-cd6c-4745-9509-c2654d9eaaa1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 72f698e5-c358-4a02-96f5-993a91ab969d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.639s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 14:59:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:e9:64:3b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 14:59:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-813316a6-23ae-4232-9a7b-f9941d26ad65 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.415s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:33 user nova-compute[75292]: INFO nova.compute.manager [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Detaching volume 290f8aba-59cb-4196-ad78-0acd19530ca0
Nov 14 14:59:33 user nova-compute[75292]: INFO nova.virt.block_device [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Attempting to driver detach volume 290f8aba-59cb-4196-ad78-0acd19530ca0 from mountpoint /dev/vdb
Nov 14 14:59:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Attempting to detach device vdb from instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 14:59:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:59:33 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:59:33 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:59:33 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:59:33 user nova-compute[75292]:   <serial>290f8aba-59cb-4196-ad78-0acd19530ca0</serial>
Nov 14 14:59:33 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:59:33 user nova-compute[75292]: </disk>
Nov 14 14:59:33 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:59:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully detached device vdb from instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 from the persistent domain config.
Nov 14 14:59:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 14:59:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 14:59:33 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 14:59:33 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 14:59:33 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 14:59:33 user nova-compute[75292]:   <serial>290f8aba-59cb-4196-ad78-0acd19530ca0</serial>
Nov 14 14:59:33 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 14:59:33 user nova-compute[75292]: </disk>
Nov 14 14:59:33 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 14:59:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 14:59:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 14:59:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 14:59:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid a8a94376-8ca1-4e3d-84b5-e597543f7ce4 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid a0ec539c-cd6c-4745-9509-c2654d9eaaa1 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:40 user nova-compute[75292]: INFO nova.compute.manager [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Terminating instance
Nov 14 14:59:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-ade9aaf4-1fdb-4ae4-ac06-d43e4991c4eb req-6c099aa9-41aa-4dcd-90c9-d771952c2677 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-unplugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ade9aaf4-1fdb-4ae4-ac06-d43e4991c4eb req-6c099aa9-41aa-4dcd-90c9-d771952c2677 service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ade9aaf4-1fdb-4ae4-ac06-d43e4991c4eb req-6c099aa9-41aa-4dcd-90c9-d771952c2677 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ade9aaf4-1fdb-4ae4-ac06-d43e4991c4eb req-6c099aa9-41aa-4dcd-90c9-d771952c2677 service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-ade9aaf4-1fdb-4ae4-ac06-d43e4991c4eb req-6c099aa9-41aa-4dcd-90c9-d771952c2677 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-unplugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-ade9aaf4-1fdb-4ae4-ac06-d43e4991c4eb req-6c099aa9-41aa-4dcd-90c9-d771952c2677 service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-unplugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Instance destroyed successfully.
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'resources' on Instance uuid ed79b252-324c-461d-bd4b-bc379d1a1bb7 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T14:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1491484863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1491484863',id=39,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHia5k7NRXViV0XgNAyzDXay3u7jjO0eHRVzHcAXEXTN5yukqVmfCFFlxnczgbajI4Olo3rSbn71LbM5K+TBQI2xLK6qkg1LafYuZIdb9wrUTVicAw4/7xxTMOjXLiosbA==',key_name='tempest-keypair-1738255639',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-y01osgqc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=ed79b252-324c-461d-bd4b-bc379d1a1bb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "address": "fa:16:3e:5f:9f:00", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5962ed86-a9", "ovs_interfaceid": "5962ed86-a94f-4ee3-a048-e67a38860eb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG os_vif [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5962ed86-a9, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6754d040-489e-4f50-8846-05f030018102) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:41 user nova-compute[75292]: INFO os_vif [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:9f:00,bridge_name='br-int',has_traffic_filtering=True,id=5962ed86-a94f-4ee3-a048-e67a38860eb0,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5962ed86-a9')
Nov 14 14:59:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Deleting instance files /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7_del
Nov 14 14:59:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Deletion of /opt/stack/data/nova/instances/ed79b252-324c-461d-bd4b-bc379d1a1bb7_del complete
Nov 14 14:59:41 user nova-compute[75292]: INFO nova.compute.manager [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 14:59:41 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:59:41 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:59:43 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Took 1.34 seconds to deallocate network for instance.
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] Acquiring lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] No waiting events found dispatching network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:59:43 user nova-compute[75292]: WARNING nova.compute.manager [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received unexpected event network-vif-plugged-5962ed86-a94f-4ee3-a048-e67a38860eb0 for instance with vm_state deleted and task_state None.
Nov 14 14:59:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-8966cc6b-2084-4a5f-a832-fdb485d85ff0 req-8cbf4bbe-5372-4c86-a864-f44a442f751d service nova] [instance: ed79b252-324c-461d-bd4b-bc379d1a1bb7] Received event network-vif-deleted-5962ed86-a94f-4ee3-a048-e67a38860eb0 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:43 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Deleted allocations for instance ed79b252-324c-461d-bd4b-bc379d1a1bb7
Nov 14 14:59:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-242da520-8e1a-4521-91c9-067bf60f2029 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "ed79b252-324c-461d-bd4b-bc379d1a1bb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.702s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 is timed out.
Nov 14 14:59:54 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully detached device vdb from instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9 from the live domain config.
Nov 14 14:59:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRePGksl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:59:54 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[56515148-63fc-4286-9233-4b513912e270]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:59:54 user nova-compute[75292]: No targets found.
Nov 14 14:59:54 user nova-compute[75292]: iSNS:
Nov 14 14:59:54 user nova-compute[75292]: No targets found.
Nov 14 14:59:54 user nova-compute[75292]: STATIC:
Nov 14 14:59:54 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:59:54 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:54 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:54 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0
Nov 14 14:59:54 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:54 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:54 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 14:59:54 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:54 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:54 user nova-compute[75292]: FIRMWARE:
Nov 14 14:59:54 user nova-compute[75292]: No targets found.
Nov 14 14:59:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:59:54 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:59:54 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954fdfc-3577-4741-a3b1-1e4fb7a86750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2139fc06-b00f-4818-8745-de088ac5e3b8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:54 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:54 user nova-compute[75292]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 (non-flash)
Nov 14 14:59:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:54 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:54 user nova-compute[75292]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 (non-flash)
Nov 14 14:59:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc06b6b-c96e-40d9-95c6-34be08eba089]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48edcbe1-5490-4efd-bd4b-c229f3ce1116]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b2ec7-e920-45c8-ac53-ed59c6d67034]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccd0c09-2c35-432d-83cd-1e674d3f40ab]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbcf613-87f9-445a-a7fa-16e8271fb8a6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03715d3-722b-473a-b8da-d71d766fce31]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260]
Nov 14 14:59:54 user nova-compute[75292]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0, portal: 172.16.0.220,3260] successful.
Nov 14 14:59:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290f8aba-59cb-4196-ad78-0acd19530ca0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f05c65a-702c-4aa9-bfd9-1d28ea312da2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== disconnect_volume: return (305ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:59:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:59:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8301dfa-e9cd-419a-a5fc-4c7344c63f40 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.585s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.280s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:57 user nova-compute[75292]: INFO nova.compute.manager [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Terminating instance
Nov 14 14:59:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-54261f16-8d15-4eca-9b58-a0bf56cd1a96 req-79d12745-95eb-4d9a-b5f5-112be52b5fa1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-54261f16-8d15-4eca-9b58-a0bf56cd1a96 req-79d12745-95eb-4d9a-b5f5-112be52b5fa1 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-54261f16-8d15-4eca-9b58-a0bf56cd1a96 req-79d12745-95eb-4d9a-b5f5-112be52b5fa1 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-54261f16-8d15-4eca-9b58-a0bf56cd1a96 req-79d12745-95eb-4d9a-b5f5-112be52b5fa1 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-54261f16-8d15-4eca-9b58-a0bf56cd1a96 req-79d12745-95eb-4d9a-b5f5-112be52b5fa1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG nova.compute.manager [req-54261f16-8d15-4eca-9b58-a0bf56cd1a96 req-79d12745-95eb-4d9a-b5f5-112be52b5fa1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-unplugged-4adea91d-1181-4be9-8723-50283103689f for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Instance destroyed successfully.
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'resources' on Instance uuid 5399567a-14b0-42ce-9fe0-b0fb74249b85 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4379320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4379320',id=29,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:46:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-u57s3mvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:47:59Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=5399567a-14b0-42ce-9fe0-b0fb74249b85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "4adea91d-1181-4be9-8723-50283103689f", "address": "fa:16:3e:25:f8:ab", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4adea91d-11", "ovs_interfaceid": "4adea91d-1181-4be9-8723-50283103689f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_vif [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4adea91d-11, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d6babc6-2e20-48ec-aeac-bcfa115efd21) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 14:59:58 user nova-compute[75292]: INFO os_vif [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=4adea91d-1181-4be9-8723-50283103689f,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4adea91d-11')
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbMxfzrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 14:59:58 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7235f10-3fde-426f-abeb-3b5632df98c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 14:59:58 user nova-compute[75292]: No targets found.
Nov 14 14:59:58 user nova-compute[75292]: iSNS:
Nov 14 14:59:58 user nova-compute[75292]: No targets found.
Nov 14 14:59:58 user nova-compute[75292]: STATIC:
Nov 14 14:59:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2
Nov 14 14:59:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:58 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 14:59:58 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 14:59:58 user nova-compute[75292]:                 Iface Name: default
Nov 14 14:59:58 user nova-compute[75292]: FIRMWARE:
Nov 14 14:59:58 user nova-compute[75292]: No targets found.
Nov 14 14:59:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 14:59:58 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 14:59:58 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e194d2c1-b0df-4252-8894-e80c91649814]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aab01a-67a8-4e5c-9074-56bd85c37519]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:58 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 (non-flash)
Nov 14 14:59:58 user nova-compute[75292]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 14:59:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542ac160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2'): ({'sdd'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Removing single pathed devices sdd {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68034336-5adf-4eae-9197-e674377ce37b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4ec18-4913-455f-83cf-1ae0945b0875]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Flushing IO for device /dev/sdd {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed25b8-8041-4dfe-a100-7f130ae4f273]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1379643f-74a1-45d2-a889-7f9c3f425fac]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ad1f97-589c-4915-a227-fd7b801da504]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0fb703-4508-46dc-9022-f79e3ab3cfe5]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260]
Nov 14 14:59:58 user nova-compute[75292]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2, portal: 172.16.0.220,3260] successful.
Nov 14 14:59:58 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfb18055-e5b6-45f8-9efa-a290d1c4dbf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac938fa-f069-456c-b20f-e91dd42884be]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] <== disconnect_volume: return (306ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 14:59:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Deleting instance files /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85_del
Nov 14 14:59:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Deletion of /opt/stack/data/nova/instances/5399567a-14b0-42ce-9fe0-b0fb74249b85_del complete
Nov 14 14:59:58 user nova-compute[75292]: INFO nova.compute.manager [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 14:59:58 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 14:59:58 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 14:59:59 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 14:59:59 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Took 0.54 seconds to deallocate network for instance.
Nov 14 14:59:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] Acquiring lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 14:59:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 14:59:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] No waiting events found dispatching network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 14:59:59 user nova-compute[75292]: WARNING nova.compute.manager [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received unexpected event network-vif-plugged-4adea91d-1181-4be9-8723-50283103689f for instance with vm_state active and task_state deleting.
Nov 14 14:59:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-f7be826f-b790-4967-af85-8f0383ece64d req-c1c3575d-6ab0-4f5d-9cb4-41a7a812a9c1 service nova] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Received event network-vif-deleted-4adea91d-1181-4be9-8723-50283103689f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 14:59:59 user nova-compute[75292]: INFO nova.compute.manager [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: 5399567a-14b0-42ce-9fe0-b0fb74249b85] Took 0.77 seconds to detach 1 volumes for instance.
Nov 14 14:59:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 14:59:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:00:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:00:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:00 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Deleted allocations for instance 5399567a-14b0-42ce-9fe0-b0fb74249b85
Nov 14 15:00:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c0be9334-54d6-43e7-bec6-9ea40ce6505e tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "5399567a-14b0-42ce-9fe0-b0fb74249b85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.832s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:18 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating instance_info_cache with network_info: [{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:00:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:00:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:23 user nova-compute[75292]: INFO nova.compute.manager [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Terminating instance
Nov 14 15:00:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-7361209f-5cb8-4388-9232-76f821f3ed02 req-66007f08-b9ac-4838-bf1b-092daad8e6a8 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-vif-unplugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7361209f-5cb8-4388-9232-76f821f3ed02 req-66007f08-b9ac-4838-bf1b-092daad8e6a8 service nova] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7361209f-5cb8-4388-9232-76f821f3ed02 req-66007f08-b9ac-4838-bf1b-092daad8e6a8 service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7361209f-5cb8-4388-9232-76f821f3ed02 req-66007f08-b9ac-4838-bf1b-092daad8e6a8 service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-7361209f-5cb8-4388-9232-76f821f3ed02 req-66007f08-b9ac-4838-bf1b-092daad8e6a8 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] No waiting events found dispatching network-vif-unplugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-7361209f-5cb8-4388-9232-76f821f3ed02 req-66007f08-b9ac-4838-bf1b-092daad8e6a8 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-vif-unplugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Instance destroyed successfully.
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.objects.instance [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'resources' on Instance uuid 7eae039c-7751-46d6-b4c0-c15dc89a78b9 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-421272435',display_name='tempest-AttachVolumeNegativeTest-server-421272435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-421272435',id=42,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJHmZXZSRALTnsXGuR7ZPP2CGymAUzjEM1Bw5uD7IIsk2QxRGWwbW1+BRILJ8udvqHNnwAOuixBnyjx9MRehwNtpedghQAaFV+AiBhSRXtbyKu+OUFxTCeaJXEeYbAQdA==',key_name='tempest-keypair-1058922560',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:57:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-fbyix93c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=7eae039c-7751-46d6-b4c0-c15dc89a78b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "address": "fa:16:3e:e9:64:3b", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap777f46c6-4a", "ovs_interfaceid": "777f46c6-4a36-4697-89cf-2a8ed6d4bef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG os_vif [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap777f46c6-4a, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db24cb84-bb1b-49d3-8bdd-f931d68de92e) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:24 user nova-compute[75292]: INFO os_vif [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:64:3b,bridge_name='br-int',has_traffic_filtering=True,id=777f46c6-4a36-4697-89cf-2a8ed6d4bef2,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap777f46c6-4a')
Nov 14 15:00:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Deleting instance files /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9_del
Nov 14 15:00:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Deletion of /opt/stack/data/nova/instances/7eae039c-7751-46d6-b4c0-c15dc89a78b9_del complete
Nov 14 15:00:24 user nova-compute[75292]: INFO nova.compute.manager [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 15:00:24 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:00:24 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:00:25 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:25 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Took 0.95 seconds to deallocate network for instance.
Nov 14 15:00:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:26 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Deleted allocations for instance 7eae039c-7751-46d6-b4c0-c15dc89a78b9
Nov 14 15:00:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-402737d5-8b47-4269-93c1-ad75c26c2052 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.222s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] Acquiring lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] Lock "7eae039c-7751-46d6-b4c0-c15dc89a78b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] No waiting events found dispatching network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:26 user nova-compute[75292]: WARNING nova.compute.manager [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received unexpected event network-vif-plugged-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 for instance with vm_state deleted and task_state None.
Nov 14 15:00:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-652fed75-b804-4aed-8d22-ddd6e2be6792 req-6f6a6965-0d2f-45de-8529-ea333a4dee79 service nova] [instance: 7eae039c-7751-46d6-b4c0-c15dc89a78b9] Received event network-vif-deleted-777f46c6-4a36-4697-89cf-2a8ed6d4bef2 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-changed-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Refreshing instance network info cache due to event network-changed-ac4bab6e-04cd-418a-9604-5b751e26afd1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] Acquiring lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] Acquired lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG nova.network.neutron [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Refreshing network info cache for port ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG nova.network.neutron [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updated VIF entry in instance network info cache for port ac4bab6e-04cd-418a-9604-5b751e26afd1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG nova.network.neutron [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updating instance_info_cache with network_info: [{"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0cefde2d-e1bc-42b7-93d4-226f052c6892 req-0c946a69-b133-4dad-bea9-fb4d48d2c5ed service nova] Releasing lock "refresh_cache-a0ec539c-cd6c-4745-9509-c2654d9eaaa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:27 user nova-compute[75292]: INFO nova.compute.manager [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Terminating instance
Nov 14 15:00:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Instance destroyed successfully.
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'resources' on Instance uuid a0ec539c-cd6c-4745-9509-c2654d9eaaa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:58:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1081642560',display_name='tempest-TestVolumeBootPattern-server-1081642560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1081642560',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:58:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-tw014m0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:58:46Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=a0ec539c-cd6c-4745-9509-c2654d9eaaa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "address": "fa:16:3e:dd:89:a1", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac4bab6e-04", "ovs_interfaceid": "ac4bab6e-04cd-418a-9604-5b751e26afd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_vif [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac4bab6e-04, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5caaac7-ca0e-46a0-9636-921021a610f7) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:00:28 user nova-compute[75292]: INFO os_vif [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:89:a1,bridge_name='br-int',has_traffic_filtering=True,id=ac4bab6e-04cd-418a-9604-5b751e26afd1,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac4bab6e-04')
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:00:28 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a180498-02ea-4d60-be04-d0d577daf8ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:00:28 user nova-compute[75292]: No targets found.
Nov 14 15:00:28 user nova-compute[75292]: iSNS:
Nov 14 15:00:28 user nova-compute[75292]: No targets found.
Nov 14 15:00:28 user nova-compute[75292]: STATIC:
Nov 14 15:00:28 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 15:00:28 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:00:28 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:00:28 user nova-compute[75292]: FIRMWARE:
Nov 14 15:00:28 user nova-compute[75292]: No targets found.
Nov 14 15:00:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:00:28 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:00:28 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b946b9-e6f3-4948-b5d6-a81f36ef8943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89494b75-d709-4631-9ad4-3ed03c3fd8de]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:00:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:00:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b3063fd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb7603-6647-41e0-93d8-97ea90c98b91]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e05f0fe-b702-434a-a297-f26d09150fc9]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b8e150-ad02-4c62-adce-37ef2457974e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef063fd-e18e-4c55-b4eb-b54d130a16a1]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_159ed9b3', '/dev/disk/by-id/scsi-1SCST_BIO159ed9b3-40fa626f0718ecd2', '/dev/disk/by-id/scsi-23430666136323666') {{(pid=86373) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b743121-a785-415d-82f2-946d74a56269]: (4, None) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[759512f7-56fe-4953-8a6d-8d1f8c4684f2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e9b24-f68d-4996-bd3b-54b34b5c7b94]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]
Nov 14 15:00:28 user nova-compute[75292]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.
Nov 14 15:00:28 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef61dc1-3dd6-482d-ad52-0dbe8f050c53]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== disconnect_volume: return (288ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:00:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Deleting instance files /opt/stack/data/nova/instances/a0ec539c-cd6c-4745-9509-c2654d9eaaa1_del
Nov 14 15:00:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Deletion of /opt/stack/data/nova/instances/a0ec539c-cd6c-4745-9509-c2654d9eaaa1_del complete
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:00:28 user nova-compute[75292]: INFO nova.compute.manager [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 15:00:28 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:00:28 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-vif-unplugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] No waiting events found dispatching network-vif-unplugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-vif-unplugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] Acquiring lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] No waiting events found dispatching network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:29 user nova-compute[75292]: WARNING nova.compute.manager [req-9522f317-e2cf-4ccf-b83b-ae68faeb9d0d req-1fcb0063-5923-41e9-b542-369fa61c34df service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received unexpected event network-vif-plugged-ac4bab6e-04cd-418a-9604-5b751e26afd1 for instance with vm_state active and task_state deleting.
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:29 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Took 0.70 seconds to deallocate network for instance.
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9792c5b2-bcc4-4f0c-9140-172761b68a6b req-fc96c2db-6887-452a-a930-4b843064b6cb service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Received event network-vif-deleted-ac4bab6e-04cd-418a-9604-5b751e26afd1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:29 user nova-compute[75292]: INFO nova.compute.manager [req-9792c5b2-bcc4-4f0c-9140-172761b68a6b req-fc96c2db-6887-452a-a930-4b843064b6cb service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Neutron deleted interface ac4bab6e-04cd-418a-9604-5b751e26afd1; detaching it from the instance and deleting it from the info cache
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.network.neutron [req-9792c5b2-bcc4-4f0c-9140-172761b68a6b req-fc96c2db-6887-452a-a930-4b843064b6cb service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-9792c5b2-bcc4-4f0c-9140-172761b68a6b req-fc96c2db-6887-452a-a930-4b843064b6cb service nova] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Detach interface failed, port_id=ac4bab6e-04cd-418a-9604-5b751e26afd1, reason: Instance a0ec539c-cd6c-4745-9509-c2654d9eaaa1 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:29 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:30 user nova-compute[75292]: INFO nova.compute.manager [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: a0ec539c-cd6c-4745-9509-c2654d9eaaa1] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:30 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Deleted allocations for instance a0ec539c-cd6c-4745-9509-c2654d9eaaa1
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a8180f16-0272-426f-bf20-c808cb7a0bd4 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "a0ec539c-cd6c-4745-9509-c2654d9eaaa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.099s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:31 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:00:31 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8582MB free_disk=25.036319732666016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 72f698e5-c358-4a02-96f5-993a91ab969d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:00:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:00:34 user nova-compute[75292]: INFO nova.compute.claims [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Claim successful on node user
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:00:34 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:00:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.policy [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b3312b416c74d92ae45d7edb5c08512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f7526301dd346a9a6f3367417755a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:00:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Creating image(s)
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.192s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk 1073741824" returned: 0 in 0.050s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Successfully created port: 172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Cannot resize image /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Ensure instance console log exists: /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Successfully updated port: 172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing instance network info cache due to event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance network_info: |[{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Start _get_guest_xml network_info=[{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:00:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:00:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-499197565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-499197565',id=45,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAos6/ayEFBl8dK2N3yPu7sE42R3QPa2N2I2NH/mhQ9bMVFnf8ubKD7j2COPWKUvArA5joyHsDk0rqVbynbLzI6TSYXCm84JUcVJcZ8mSzo2UyTBaGT2j06wE+fmLe8Sg==',key_name='tempest-keypair-1317824269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-wc0iuf38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=f3b39492-5aeb-4dc2-b8bc-27b941004926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'pci_devices' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:00:36 user nova-compute[75292]:   <uuid>f3b39492-5aeb-4dc2-b8bc-27b941004926</uuid>
Nov 14 15:00:36 user nova-compute[75292]:   <name>instance-0000002d</name>
Nov 14 15:00:36 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:00:36 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:00:36 user nova-compute[75292]:   <metadata>
Nov 14 15:00:36 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:00:36 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:00:36 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-499197565</nova:name>
Nov 14 15:00:36 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:00:36</nova:creationTime>
Nov 14 15:00:36 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:00:36 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:00:36 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:00:36 user nova-compute[75292]:       <nova:owner>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:user uuid="4b3312b416c74d92ae45d7edb5c08512">tempest-AttachVolumeShelveTestJSON-2139265145-project-member</nova:user>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:project uuid="3f7526301dd346a9a6f3367417755a67">tempest-AttachVolumeShelveTestJSON-2139265145</nova:project>
Nov 14 15:00:36 user nova-compute[75292]:       </nova:owner>
Nov 14 15:00:36 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:00:36 user nova-compute[75292]:       <nova:ports>
Nov 14 15:00:36 user nova-compute[75292]:         <nova:port uuid="172db38c-ba90-4c26-b1c1-a04f904da4d1">
Nov 14 15:00:36 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 15:00:36 user nova-compute[75292]:         </nova:port>
Nov 14 15:00:36 user nova-compute[75292]:       </nova:ports>
Nov 14 15:00:36 user nova-compute[75292]:     </nova:instance>
Nov 14 15:00:36 user nova-compute[75292]:   </metadata>
Nov 14 15:00:36 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:00:36 user nova-compute[75292]:     <system>
Nov 14 15:00:36 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:00:36 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:00:36 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:00:36 user nova-compute[75292]:       <entry name="serial">f3b39492-5aeb-4dc2-b8bc-27b941004926</entry>
Nov 14 15:00:36 user nova-compute[75292]:       <entry name="uuid">f3b39492-5aeb-4dc2-b8bc-27b941004926</entry>
Nov 14 15:00:36 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:00:36 user nova-compute[75292]:     </system>
Nov 14 15:00:36 user nova-compute[75292]:   </sysinfo>
Nov 14 15:00:36 user nova-compute[75292]:   <os>
Nov 14 15:00:36 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:00:36 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:00:36 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:00:36 user nova-compute[75292]:   </os>
Nov 14 15:00:36 user nova-compute[75292]:   <features>
Nov 14 15:00:36 user nova-compute[75292]:     <acpi/>
Nov 14 15:00:36 user nova-compute[75292]:     <apic/>
Nov 14 15:00:36 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:00:36 user nova-compute[75292]:   </features>
Nov 14 15:00:36 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:00:36 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:00:36 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:00:36 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:00:36 user nova-compute[75292]:   </clock>
Nov 14 15:00:36 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:00:36 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:00:36 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:00:36 user nova-compute[75292]:   </cpu>
Nov 14 15:00:36 user nova-compute[75292]:   <devices>
Nov 14 15:00:36 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:00:36 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:00:36 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk"/>
Nov 14 15:00:36 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:00:36 user nova-compute[75292]:     </disk>
Nov 14 15:00:36 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:00:36 user nova-compute[75292]:       <mac address="fa:16:3e:d7:d6:d3"/>
Nov 14 15:00:36 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:00:36 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:00:36 user nova-compute[75292]:       <target dev="tap172db38c-ba"/>
Nov 14 15:00:36 user nova-compute[75292]:     </interface>
Nov 14 15:00:36 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:00:36 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/console.log" append="off"/>
Nov 14 15:00:36 user nova-compute[75292]:     </serial>
Nov 14 15:00:36 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:00:36 user nova-compute[75292]:     <video>
Nov 14 15:00:36 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:00:36 user nova-compute[75292]:     </video>
Nov 14 15:00:36 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:00:36 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:00:36 user nova-compute[75292]:     </rng>
Nov 14 15:00:36 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:00:36 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:00:36 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:00:36 user nova-compute[75292]:     </memballoon>
Nov 14 15:00:36 user nova-compute[75292]:   </devices>
Nov 14 15:00:36 user nova-compute[75292]: </domain>
Nov 14 15:00:36 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-499197565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-499197565',id=45,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAos6/ayEFBl8dK2N3yPu7sE42R3QPa2N2I2NH/mhQ9bMVFnf8ubKD7j2COPWKUvArA5joyHsDk0rqVbynbLzI6TSYXCm84JUcVJcZ8mSzo2UyTBaGT2j06wE+fmLe8Sg==',key_name='tempest-keypair-1317824269',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-wc0iuf38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=f3b39492-5aeb-4dc2-b8bc-27b941004926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG os_vif [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef90a5b2-bc0b-5469-8df2-55904f56d0ca', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap172db38c-ba, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap172db38c-ba, col_values=(('qos', UUID('b5b0e3c7-2556-49ee-b25c-2a61214bd901')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap172db38c-ba, col_values=(('external_ids', {'iface-id': '172db38c-ba90-4c26-b1c1-a04f904da4d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:d6:d3', 'vm-uuid': 'f3b39492-5aeb-4dc2-b8bc-27b941004926'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:36 user nova-compute[75292]: INFO os_vif [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba')
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No VIF found with MAC fa:16:3e:d7:d6:d3, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:00:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:00:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updated VIF entry in instance network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:00:37 user nova-compute[75292]: DEBUG nova.network.neutron [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e4325a83-d16c-49e6-8f94-ca0daa1cc727 req-d6908f55-f324-496d-819c-3ece3dae5c6c service nova] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-ed7e537e-702e-4766-9332-e03c55f8689e req-7959a65b-e337-4cf9-8deb-00d8f5110c5f service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ed7e537e-702e-4766-9332-e03c55f8689e req-7959a65b-e337-4cf9-8deb-00d8f5110c5f service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ed7e537e-702e-4766-9332-e03c55f8689e req-7959a65b-e337-4cf9-8deb-00d8f5110c5f service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ed7e537e-702e-4766-9332-e03c55f8689e req-7959a65b-e337-4cf9-8deb-00d8f5110c5f service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-ed7e537e-702e-4766-9332-e03c55f8689e req-7959a65b-e337-4cf9-8deb-00d8f5110c5f service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:38 user nova-compute[75292]: WARNING nova.compute.manager [req-ed7e537e-702e-4766-9332-e03c55f8689e req-7959a65b-e337-4cf9-8deb-00d8f5110c5f service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state building and task_state spawning.
Nov 14 15:00:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:00:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance spawned successfully.
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:00:40 user nova-compute[75292]: INFO nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-changed-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Refreshing instance network info cache due to event network-changed-fae0661b-7e74-41ad-b544-59c26792f6cd. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] Acquiring lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] Acquired lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Refreshing network info cache for port fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:00:40 user nova-compute[75292]: INFO nova.compute.manager [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Took 5.75 seconds to build instance.
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-1251d7d5-df2e-4b4b-8781-73b907717252 req-ceda2295-be8b-452f-895a-befe77d2a9f5 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1251d7d5-df2e-4b4b-8781-73b907717252 req-ceda2295-be8b-452f-895a-befe77d2a9f5 service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1251d7d5-df2e-4b4b-8781-73b907717252 req-ceda2295-be8b-452f-895a-befe77d2a9f5 service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-1251d7d5-df2e-4b4b-8781-73b907717252 req-ceda2295-be8b-452f-895a-befe77d2a9f5 service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-1251d7d5-df2e-4b4b-8781-73b907717252 req-ceda2295-be8b-452f-895a-befe77d2a9f5 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:40 user nova-compute[75292]: WARNING nova.compute.manager [req-1251d7d5-df2e-4b4b-8781-73b907717252 req-ceda2295-be8b-452f-895a-befe77d2a9f5 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state active and task_state None.
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6d97e5e1-b4a2-4911-8066-e5fa4710d726 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.846s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updated VIF entry in instance network info cache for port fae0661b-7e74-41ad-b544-59c26792f6cd. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.network.neutron [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating instance_info_cache with network_info: [{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dd1a51ad-92b1-43e9-babb-421ec9fb3bc5 req-22efab91-3a31-4094-9121-c44faf4d6e3c service nova] Releasing lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG nova.objects.instance [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'flavor' on Instance uuid 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:00:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:41 user nova-compute[75292]: INFO nova.compute.manager [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Attaching volume 0aee19a0-729b-4095-8984-dc5d5b127a06 to /dev/vdb
Nov 14 15:00:41 user nova-compute[75292]: DEBUG os_brick.utils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c65621-7a54-4450-bab7-673158bf40eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7415c3f-d077-4f8b-8c98-480842c0ed95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b62bdd-7d04-4925-a7c2-de9b0b628d3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3697cac5-f81f-44e6-a532-0a2bab955d9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:00:41 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:00:41 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d826d086-a4a1-44b4-b6f7-c04045ca2b44]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG os_brick.utils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating existing volume attachment record: ea8fd94a-a36d-4096-97b7-79f7a6f4f0c6 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:00:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHhtGikR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:00:45 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:00:45 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:00:45 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[333cc14a-b8a6-4bfe-8b35-625c7aef9812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:00:45 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c562968-87d8-4452-8391-6c717346d8f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06] added
Nov 14 15:00:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c88907-ff74-4a09-8963-49861dbe014d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df55d16-b569-43fd-86b5-8185efe0cd39]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHhtGikR {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHhtGikR" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea0d073-6a16-47ac-9c6d-c1421f8ab7a1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dHhtGikR'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[064c2e22-697c-493e-8128-033f0a37796d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[28000551-b438-44f2-ab8c-603427d0cc19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:00:45 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:00:45 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:00:45 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:00:45 user nova-compute[75292]: 
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2621528c-3fbb-41bd-af5c-5d5cfc0c7af9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260]
Nov 14 15:00:45 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260] successful.
Nov 14 15:00:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb16617-bd3e-4765-a67b-f2ace242c16c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d711f423-b487-4f53-a2a6-c56dec6e4066]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 (non-flash)
Nov 14 15:00:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 (non-flash)
Nov 14 15:00:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db55b4e-c5f4-4624-bba9-9a260b827307]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:00:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHhtGikR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:00:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:00:46 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23135346566613565', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:00:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135346566613565', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:00:46 user nova-compute[75292]: DEBUG nova.objects.instance [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'flavor' on Instance uuid 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:00:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:00:46 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:00:46 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:00:46 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:00:46 user nova-compute[75292]:   <serial>0aee19a0-729b-4095-8984-dc5d5b127a06</serial>
Nov 14 15:00:46 user nova-compute[75292]: </disk>
Nov 14 15:00:46 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:00:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:00:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:00:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] No VIF found with MAC fa:16:3e:aa:8b:5e, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:00:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-38d5959f-5150-4807-b3c9-f02790cab54b tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.389s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:48 user nova-compute[75292]: INFO nova.compute.manager [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Terminating instance
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-af01bd6b-33e8-4574-a8a1-b272384340b1 req-80ecc57c-9c32-47a0-804b-13ea23615c0f service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-vif-unplugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af01bd6b-33e8-4574-a8a1-b272384340b1 req-80ecc57c-9c32-47a0-804b-13ea23615c0f service nova] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af01bd6b-33e8-4574-a8a1-b272384340b1 req-80ecc57c-9c32-47a0-804b-13ea23615c0f service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af01bd6b-33e8-4574-a8a1-b272384340b1 req-80ecc57c-9c32-47a0-804b-13ea23615c0f service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-af01bd6b-33e8-4574-a8a1-b272384340b1 req-80ecc57c-9c32-47a0-804b-13ea23615c0f service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] No waiting events found dispatching network-vif-unplugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.compute.manager [req-af01bd6b-33e8-4574-a8a1-b272384340b1 req-80ecc57c-9c32-47a0-804b-13ea23615c0f service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-vif-unplugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:48 user nova-compute[75292]: INFO nova.compute.manager [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Detaching volume 0aee19a0-729b-4095-8984-dc5d5b127a06
Nov 14 15:00:48 user nova-compute[75292]: INFO nova.virt.block_device [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Attempting to driver detach volume 0aee19a0-729b-4095-8984-dc5d5b127a06 from mountpoint /dev/vdb
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Attempting to detach device vdb from instance 72f698e5-c358-4a02-96f5-993a91ab969d from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:00:48 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:00:48 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:00:48 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:00:48 user nova-compute[75292]:   <serial>0aee19a0-729b-4095-8984-dc5d5b127a06</serial>
Nov 14 15:00:48 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:00:48 user nova-compute[75292]: </disk>
Nov 14 15:00:48 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:00:48 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully detached device vdb from instance 72f698e5-c358-4a02-96f5-993a91ab969d from the persistent domain config.
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72f698e5-c358-4a02-96f5-993a91ab969d from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:00:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:00:48 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:00:48 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:00:48 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:00:48 user nova-compute[75292]:   <serial>0aee19a0-729b-4095-8984-dc5d5b127a06</serial>
Nov 14 15:00:48 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:00:48 user nova-compute[75292]: </disk>
Nov 14 15:00:48 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:00:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Instance destroyed successfully.
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lazy-loading 'resources' on Instance uuid a8a94376-8ca1-4e3d-84b5-e597543f7ce4 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-982198259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-982198259',id=24,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60ef654d69c34328893549c7a124aebf',ramdisk_id='',reservation_id='r-03pginpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-172724502',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:43:10Z,user_data=None,user_id='38a8da6883ae40c4b12c8c483d598a40',uuid=a8a94376-8ca1-4e3d-84b5-e597543f7ce4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converting VIF {"id": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "address": "fa:16:3e:49:1b:d5", "network": {"id": "48c66b82-070f-4b7d-839f-ce1c40507a0a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1365799239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60ef654d69c34328893549c7a124aebf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b668cf2-43", "ovs_interfaceid": "3b668cf2-43b9-45cf-a99c-a98a74f0dff1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG os_vif [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b668cf2-43, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c381a2d1-867e-4883-9fd7-3d74d22fa032) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:49 user nova-compute[75292]: INFO os_vif [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:1b:d5,bridge_name='br-int',has_traffic_filtering=True,id=3b668cf2-43b9-45cf-a99c-a98a74f0dff1,network=Network(48c66b82-070f-4b7d-839f-ce1c40507a0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b668cf2-43')
Nov 14 15:00:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Deleting instance files /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4_del
Nov 14 15:00:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Deletion of /opt/stack/data/nova/instances/a8a94376-8ca1-4e3d-84b5-e597543f7ce4_del complete
Nov 14 15:00:49 user nova-compute[75292]: INFO nova.compute.manager [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 14 15:00:49 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:00:49 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:00:49 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Took 0.43 seconds to deallocate network for instance.
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.199s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:50 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Deleted allocations for instance a8a94376-8ca1-4e3d-84b5-e597543f7ce4
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b6fe9b7e-8f05-4116-94d0-63c387cc4126 tempest-ServerBootFromVolumeStableRescueTest-172724502 tempest-ServerBootFromVolumeStableRescueTest-172724502-project-member] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.158s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] Acquiring lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] Lock "a8a94376-8ca1-4e3d-84b5-e597543f7ce4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:00:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] No waiting events found dispatching network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:00:50 user nova-compute[75292]: WARNING nova.compute.manager [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received unexpected event network-vif-plugged-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 for instance with vm_state deleted and task_state None.
Nov 14 15:00:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-596228b6-dd99-49f0-a68b-c13827346efe req-3ca2626d-4c86-494f-8122-04c909bdc353 service nova] [instance: a8a94376-8ca1-4e3d-84b5-e597543f7ce4] Received event network-vif-deleted-3b668cf2-43b9-45cf-a99c-a98a74f0dff1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:00:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:00:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:09 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72f698e5-c358-4a02-96f5-993a91ab969d is timed out.
Nov 14 15:01:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully detached device vdb from instance 72f698e5-c358-4a02-96f5-993a91ab969d from the live domain config.
Nov 14 15:01:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHhtGikR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:01:09 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7011e7-966e-4d7e-9572-23b5880a07d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:01:09 user nova-compute[75292]: No targets found.
Nov 14 15:01:09 user nova-compute[75292]: iSNS:
Nov 14 15:01:09 user nova-compute[75292]: No targets found.
Nov 14 15:01:09 user nova-compute[75292]: STATIC:
Nov 14 15:01:09 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06
Nov 14 15:01:09 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:01:09 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:01:09 user nova-compute[75292]: FIRMWARE:
Nov 14 15:01:09 user nova-compute[75292]: No targets found.
Nov 14 15:01:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:01:09 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:01:09 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d737710-39f4-49bb-ae97-e5aa2a5fa952]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34079be-6716-4501-bfb8-acbb085c4750]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 (non-flash)
Nov 14 15:01:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 (non-flash)
Nov 14 15:01:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b781de7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37607b77-dce3-483b-961d-1b41d72adade]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c921a-0fdc-4b60-95be-154ee0f836d8]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b7d64-9bd0-4990-b311-29d81e213929]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[518bc013-8f53-4c61-bcd8-7038707dfbf5]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd6056-24d8-4a86-bf91-d640df09f5a3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[915195c0-9a33-4743-9779-f2a502a00e8f]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260]
Nov 14 15:01:09 user nova-compute[75292]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06, portal: 172.16.0.220,3260] successful.
Nov 14 15:01:09 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0aee19a0-729b-4095-8984-dc5d5b127a06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[018fdb59-8148-4a81-8262-46a2eef14955]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] <== disconnect_volume: return (303ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:01:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:01:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:10 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'flavor' on Instance uuid 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:01:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ce4b6f7e-b837-45aa-9793-a679a7244e1e tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.640s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:01:17 user nova-compute[75292]: INFO nova.compute.claims [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Claim successful on node user
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:01:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:01:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:01:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Creating image(s)
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "/opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk 1073741824" returned: 0 in 0.046s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.policy [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3a7efbb426e4b558031f14a751e102b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae1d477a1d84afeb07533cddfe992d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Cannot resize image /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Ensure instance console log exists: /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Successfully created port: 312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:01:19 user nova-compute[75292]: INFO nova.compute.claims [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Claim successful on node user
Nov 14 15:01:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Successfully updated port: 312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:01:19 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquired lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-changed-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Refreshing instance network info cache due to event network-changed-312324fb-cd80-4558-adfb-d88d762d25fa. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] Acquiring lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.policy [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12846e84377c40998d795e5f0b09252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebd367820b4847b1f8b7c402a22ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:01:19 user nova-compute[75292]: INFO nova.virt.block_device [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Booting with volume 15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a at /dev/vda
Nov 14 15:01:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG os_brick.utils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ea068-9faf-4feb-b276-8b8e46ddcdbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:19 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b96187-7cf8-44d4-ba51-bed21fb7886a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e575d9b-4267-4934-8899-24ace44a1fa8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[321db9fb-68dc-4c04-a29d-532996a35615]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:01:20 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[54985b83-fe1d-49ec-94ed-8e4be8767a55]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG os_brick.utils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating existing volume attachment record: 5903cfbc-8623-44f4-b4cc-84cff56c2ed7 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updating instance_info_cache with network_info: [{"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Releasing lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Instance network_info: |[{"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] Acquired lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Refreshing network info cache for port 312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Start _get_guest_xml network_info=[{"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:01:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1305627516',display_name='tempest-AttachVolumeNegativeTest-server-1305627516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1305627516',id=46,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhpMh/RvGVZ+muP3/yNzMqqX+ixdNKdfU4mLiIAmLT407BM+E6VN5IRRdKjZHsmQRfdN672c15omMmV/zU9z7zHl4W5mShWsbK3c8zySzm1+asMJetLiVvRMamtU6tneg==',key_name='tempest-keypair-1592721271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-oa0q86la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=ec5a27b8-5266-40b8-bcb9-6de4cc33a511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'pci_devices' on Instance uuid ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:01:20 user nova-compute[75292]:   <uuid>ec5a27b8-5266-40b8-bcb9-6de4cc33a511</uuid>
Nov 14 15:01:20 user nova-compute[75292]:   <name>instance-0000002e</name>
Nov 14 15:01:20 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:01:20 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:01:20 user nova-compute[75292]:   <metadata>
Nov 14 15:01:20 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:01:20 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:01:20 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1305627516</nova:name>
Nov 14 15:01:20 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:01:20</nova:creationTime>
Nov 14 15:01:20 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:01:20 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:01:20 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:01:20 user nova-compute[75292]:       <nova:owner>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:user uuid="d3a7efbb426e4b558031f14a751e102b">tempest-AttachVolumeNegativeTest-547312228-project-member</nova:user>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:project uuid="8ae1d477a1d84afeb07533cddfe992d1">tempest-AttachVolumeNegativeTest-547312228</nova:project>
Nov 14 15:01:20 user nova-compute[75292]:       </nova:owner>
Nov 14 15:01:20 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:01:20 user nova-compute[75292]:       <nova:ports>
Nov 14 15:01:20 user nova-compute[75292]:         <nova:port uuid="312324fb-cd80-4558-adfb-d88d762d25fa">
Nov 14 15:01:20 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 15:01:20 user nova-compute[75292]:         </nova:port>
Nov 14 15:01:20 user nova-compute[75292]:       </nova:ports>
Nov 14 15:01:20 user nova-compute[75292]:     </nova:instance>
Nov 14 15:01:20 user nova-compute[75292]:   </metadata>
Nov 14 15:01:20 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:01:20 user nova-compute[75292]:     <system>
Nov 14 15:01:20 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:01:20 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:01:20 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:01:20 user nova-compute[75292]:       <entry name="serial">ec5a27b8-5266-40b8-bcb9-6de4cc33a511</entry>
Nov 14 15:01:20 user nova-compute[75292]:       <entry name="uuid">ec5a27b8-5266-40b8-bcb9-6de4cc33a511</entry>
Nov 14 15:01:20 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:01:20 user nova-compute[75292]:     </system>
Nov 14 15:01:20 user nova-compute[75292]:   </sysinfo>
Nov 14 15:01:20 user nova-compute[75292]:   <os>
Nov 14 15:01:20 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:01:20 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:01:20 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:01:20 user nova-compute[75292]:   </os>
Nov 14 15:01:20 user nova-compute[75292]:   <features>
Nov 14 15:01:20 user nova-compute[75292]:     <acpi/>
Nov 14 15:01:20 user nova-compute[75292]:     <apic/>
Nov 14 15:01:20 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:01:20 user nova-compute[75292]:   </features>
Nov 14 15:01:20 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:01:20 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:01:20 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:01:20 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:01:20 user nova-compute[75292]:   </clock>
Nov 14 15:01:20 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:01:20 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:01:20 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:01:20 user nova-compute[75292]:   </cpu>
Nov 14 15:01:20 user nova-compute[75292]:   <devices>
Nov 14 15:01:20 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:01:20 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:01:20 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk"/>
Nov 14 15:01:20 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:01:20 user nova-compute[75292]:     </disk>
Nov 14 15:01:20 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:01:20 user nova-compute[75292]:       <mac address="fa:16:3e:c9:5b:ef"/>
Nov 14 15:01:20 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:01:20 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:01:20 user nova-compute[75292]:       <target dev="tap312324fb-cd"/>
Nov 14 15:01:20 user nova-compute[75292]:     </interface>
Nov 14 15:01:20 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:01:20 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/console.log" append="off"/>
Nov 14 15:01:20 user nova-compute[75292]:     </serial>
Nov 14 15:01:20 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:01:20 user nova-compute[75292]:     <video>
Nov 14 15:01:20 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:01:20 user nova-compute[75292]:     </video>
Nov 14 15:01:20 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:01:20 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:01:20 user nova-compute[75292]:     </rng>
Nov 14 15:01:20 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:01:20 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:01:20 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:01:20 user nova-compute[75292]:     </memballoon>
Nov 14 15:01:20 user nova-compute[75292]:   </devices>
Nov 14 15:01:20 user nova-compute[75292]: </domain>
Nov 14 15:01:20 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1305627516',display_name='tempest-AttachVolumeNegativeTest-server-1305627516',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1305627516',id=46,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhpMh/RvGVZ+muP3/yNzMqqX+ixdNKdfU4mLiIAmLT407BM+E6VN5IRRdKjZHsmQRfdN672c15omMmV/zU9z7zHl4W5mShWsbK3c8zySzm1+asMJetLiVvRMamtU6tneg==',key_name='tempest-keypair-1592721271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-oa0q86la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=ec5a27b8-5266-40b8-bcb9-6de4cc33a511,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG os_vif [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cc10294-9c31-53f5-87d1-1e929db277b9', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap312324fb-cd, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap312324fb-cd, col_values=(('qos', UUID('60d40593-28c4-471b-b9bb-616f7c4c382e')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap312324fb-cd, col_values=(('external_ids', {'iface-id': '312324fb-cd80-4558-adfb-d88d762d25fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:5b:ef', 'vm-uuid': 'ec5a27b8-5266-40b8-bcb9-6de4cc33a511'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:20 user nova-compute[75292]: INFO os_vif [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd')
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:c9:5b:ef, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updated VIF entry in instance network info cache for port 312324fb-cd80-4558-adfb-d88d762d25fa. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.neutron [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updating instance_info_cache with network_info: [{"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-06057307-b3c9-4f60-bc81-9f8179709178 req-e1b58ce3-8e97-47f9-8ad7-b1478988c8ee service nova] Releasing lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG nova.network.neutron [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Successfully created port: 0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:01:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Successfully updated port: 0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquired lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-changed-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Refreshing instance network info cache due to event network-changed-0eddc264-57d8-4aea-8c80-3c8b55af501f. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] Acquiring lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.network.neutron [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating instance_info_cache with network_info: [{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Releasing lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Instance network_info: |[{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] Acquired lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Refreshing network info cache for port 0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb7068ee-8457-4bb8-832c-bd951fc5da05 req-56fea1e9-6b05-4c99-a69c-c88c00bbae62 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb7068ee-8457-4bb8-832c-bd951fc5da05 req-56fea1e9-6b05-4c99-a69c-c88c00bbae62 service nova] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb7068ee-8457-4bb8-832c-bd951fc5da05 req-56fea1e9-6b05-4c99-a69c-c88c00bbae62 service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-fb7068ee-8457-4bb8-832c-bd951fc5da05 req-56fea1e9-6b05-4c99-a69c-c88c00bbae62 service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-fb7068ee-8457-4bb8-832c-bd951fc5da05 req-56fea1e9-6b05-4c99-a69c-c88c00bbae62 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] No waiting events found dispatching network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:21 user nova-compute[75292]: WARNING nova.compute.manager [req-fb7068ee-8457-4bb8-832c-bd951fc5da05 req-56fea1e9-6b05-4c99-a69c-c88c00bbae62 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received unexpected event network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa for instance with vm_state building and task_state spawning.
Nov 14 15:01:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updated VIF entry in instance network info cache for port 0eddc264-57d8-4aea-8c80-3c8b55af501f. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG nova.network.neutron [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating instance_info_cache with network_info: [{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c170791a-6f71-4e0f-bb1d-69aa95aa9a08 req-57f2bb45-3f8c-40c1-be59-499c1327b9fa service nova] Releasing lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:22 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating instance_info_cache with network_info: [{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:01:23 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Instance spawned successfully.
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-a94b6fb9-cb3a-41b2-af89-0529803db0af req-4ecfd327-2fc0-4a12-9930-5c2e2b3327f1 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a94b6fb9-cb3a-41b2-af89-0529803db0af req-4ecfd327-2fc0-4a12-9930-5c2e2b3327f1 service nova] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a94b6fb9-cb3a-41b2-af89-0529803db0af req-4ecfd327-2fc0-4a12-9930-5c2e2b3327f1 service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-a94b6fb9-cb3a-41b2-af89-0529803db0af req-4ecfd327-2fc0-4a12-9930-5c2e2b3327f1 service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-a94b6fb9-cb3a-41b2-af89-0529803db0af req-4ecfd327-2fc0-4a12-9930-5c2e2b3327f1 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] No waiting events found dispatching network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:23 user nova-compute[75292]: WARNING nova.compute.manager [req-a94b6fb9-cb3a-41b2-af89-0529803db0af req-4ecfd327-2fc0-4a12-9930-5c2e2b3327f1 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received unexpected event network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa for instance with vm_state building and task_state spawning.
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:24 user nova-compute[75292]: INFO nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:01:24 user nova-compute[75292]: INFO nova.compute.manager [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Took 6.53 seconds to build instance.
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2f300eb7-16a7-4304-89e8-5d507185b4d4 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.632s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:01:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Creating image(s)
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Ensure instance console log exists: /opt/stack/data/nova/instances/8dbb1152-7cb7-447b-b71e-0202c3cae831/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Start _get_guest_xml network_info=[{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5903cfbc-8623-44f4-b4cc-84cff56c2ed7', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8dbb1152-7cb7-447b-b71e-0202c3cae831', 'attached_at': '', 'detached_at': '', 'volume_id': '15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'serial': '15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:01:24 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:24 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:01:24 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:01:24 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:01:24 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5fe684-1dd3-4956-b48a-184badb1e0df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:01:24 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[66493076-0510-4701-b3d0-b4de72e49bbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a] added
Nov 14 15:01:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e4c00-e052-445b-9c9d-9982bab1ea20]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[034eda6f-d523-4272-a65d-352bfd088af2]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVopBxEW {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kVopBxEW" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c04bb2-31c2-4d0d-aa2b-7f47140e0ebf]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kVopBxEW'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e475a5-087a-4d2b-87e1-fd1b96d1a5a0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bab85a2-34c0-4058-ab19-9fe225810502]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:01:25 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:01:25 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:01:25 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:01:25 user nova-compute[75292]: 
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6052e38e-d044-4afe-9387-c70f5c7d4f4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]
Nov 14 15:01:25 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.
Nov 14 15:01:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b03cf-e925-4dfe-99f4-4844f66245dc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ec84f1-879f-486b-8b1a-4f8b62d17341]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:01:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:01:25 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[124c1faa-e24b-442b-8140-c58458fb1fc6]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23430666136323666', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430666136323666', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1100840305',display_name='tempest-TestVolumeBootPattern-server-1100840305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1100840305',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-ossq0sz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:01:20Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=8dbb1152-7cb7-447b-b71e-0202c3cae831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.objects.instance [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dbb1152-7cb7-447b-b71e-0202c3cae831 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:01:26 user nova-compute[75292]:   <uuid>8dbb1152-7cb7-447b-b71e-0202c3cae831</uuid>
Nov 14 15:01:26 user nova-compute[75292]:   <name>instance-0000002f</name>
Nov 14 15:01:26 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:01:26 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:01:26 user nova-compute[75292]:   <metadata>
Nov 14 15:01:26 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:01:26 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:01:26 user nova-compute[75292]:       <nova:name>tempest-TestVolumeBootPattern-server-1100840305</nova:name>
Nov 14 15:01:26 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:01:24</nova:creationTime>
Nov 14 15:01:26 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:01:26 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:01:26 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:01:26 user nova-compute[75292]:       <nova:owner>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:user uuid="12846e84377c40998d795e5f0b09252f">tempest-TestVolumeBootPattern-53606599-project-member</nova:user>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:project uuid="6cebd367820b4847b1f8b7c402a22ffc">tempest-TestVolumeBootPattern-53606599</nova:project>
Nov 14 15:01:26 user nova-compute[75292]:       </nova:owner>
Nov 14 15:01:26 user nova-compute[75292]:       <nova:ports>
Nov 14 15:01:26 user nova-compute[75292]:         <nova:port uuid="0eddc264-57d8-4aea-8c80-3c8b55af501f">
Nov 14 15:01:26 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 15:01:26 user nova-compute[75292]:         </nova:port>
Nov 14 15:01:26 user nova-compute[75292]:       </nova:ports>
Nov 14 15:01:26 user nova-compute[75292]:     </nova:instance>
Nov 14 15:01:26 user nova-compute[75292]:   </metadata>
Nov 14 15:01:26 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:01:26 user nova-compute[75292]:     <system>
Nov 14 15:01:26 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:01:26 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:01:26 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:01:26 user nova-compute[75292]:       <entry name="serial">8dbb1152-7cb7-447b-b71e-0202c3cae831</entry>
Nov 14 15:01:26 user nova-compute[75292]:       <entry name="uuid">8dbb1152-7cb7-447b-b71e-0202c3cae831</entry>
Nov 14 15:01:26 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:01:26 user nova-compute[75292]:     </system>
Nov 14 15:01:26 user nova-compute[75292]:   </sysinfo>
Nov 14 15:01:26 user nova-compute[75292]:   <os>
Nov 14 15:01:26 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:01:26 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:01:26 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:01:26 user nova-compute[75292]:   </os>
Nov 14 15:01:26 user nova-compute[75292]:   <features>
Nov 14 15:01:26 user nova-compute[75292]:     <acpi/>
Nov 14 15:01:26 user nova-compute[75292]:     <apic/>
Nov 14 15:01:26 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:01:26 user nova-compute[75292]:   </features>
Nov 14 15:01:26 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:01:26 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:01:26 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:01:26 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:01:26 user nova-compute[75292]:   </clock>
Nov 14 15:01:26 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:01:26 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:01:26 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:01:26 user nova-compute[75292]:   </cpu>
Nov 14 15:01:26 user nova-compute[75292]:   <devices>
Nov 14 15:01:26 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 15:01:26 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:01:26 user nova-compute[75292]:       <source dev="/dev/sdb"/>
Nov 14 15:01:26 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:01:26 user nova-compute[75292]:       <serial>15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a</serial>
Nov 14 15:01:26 user nova-compute[75292]:     </disk>
Nov 14 15:01:26 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:01:26 user nova-compute[75292]:       <mac address="fa:16:3e:f4:03:2f"/>
Nov 14 15:01:26 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:01:26 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:01:26 user nova-compute[75292]:       <target dev="tap0eddc264-57"/>
Nov 14 15:01:26 user nova-compute[75292]:     </interface>
Nov 14 15:01:26 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:01:26 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/8dbb1152-7cb7-447b-b71e-0202c3cae831/console.log" append="off"/>
Nov 14 15:01:26 user nova-compute[75292]:     </serial>
Nov 14 15:01:26 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:01:26 user nova-compute[75292]:     <video>
Nov 14 15:01:26 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:01:26 user nova-compute[75292]:     </video>
Nov 14 15:01:26 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:01:26 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:01:26 user nova-compute[75292]:     </rng>
Nov 14 15:01:26 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:01:26 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:01:26 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:01:26 user nova-compute[75292]:     </memballoon>
Nov 14 15:01:26 user nova-compute[75292]:   </devices>
Nov 14 15:01:26 user nova-compute[75292]: </domain>
Nov 14 15:01:26 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1100840305',display_name='tempest-TestVolumeBootPattern-server-1100840305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1100840305',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-ossq0sz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:01:20Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=8dbb1152-7cb7-447b-b71e-0202c3cae831,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG os_vif [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ae396e5-1c2e-50d0-abb7-23e58b8d6d55', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0eddc264-57, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0eddc264-57, col_values=(('qos', UUID('28372c38-34a8-40cf-b029-9a248841c297')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0eddc264-57, col_values=(('external_ids', {'iface-id': '0eddc264-57d8-4aea-8c80-3c8b55af501f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:03:2f', 'vm-uuid': '8dbb1152-7cb7-447b-b71e-0202c3cae831'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:26 user nova-compute[75292]: INFO os_vif [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57')
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No VIF found with MAC fa:16:3e:f4:03:2f, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:01:26 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-86c36d6b-4566-4f63-856f-58646968c2f1 req-ef9ae7ab-910f-4f96-ae60-8e6dd3abc883 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-86c36d6b-4566-4f63-856f-58646968c2f1 req-ef9ae7ab-910f-4f96-ae60-8e6dd3abc883 service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-86c36d6b-4566-4f63-856f-58646968c2f1 req-ef9ae7ab-910f-4f96-ae60-8e6dd3abc883 service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-86c36d6b-4566-4f63-856f-58646968c2f1 req-ef9ae7ab-910f-4f96-ae60-8e6dd3abc883 service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:27 user nova-compute[75292]: DEBUG nova.compute.manager [req-86c36d6b-4566-4f63-856f-58646968c2f1 req-ef9ae7ab-910f-4f96-ae60-8e6dd3abc883 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:27 user nova-compute[75292]: WARNING nova.compute.manager [req-86c36d6b-4566-4f63-856f-58646968c2f1 req-ef9ae7ab-910f-4f96-ae60-8e6dd3abc883 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received unexpected event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with vm_state building and task_state spawning.
Nov 14 15:01:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:01:29 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Instance spawned successfully.
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:29 user nova-compute[75292]: INFO nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Took 4.91 seconds to spawn the instance on the hypervisor.
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-7557d160-44dc-4622-baac-c3a4e5246a8d req-906d0f8f-90ee-433c-b1b8-850f7a5f95e6 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7557d160-44dc-4622-baac-c3a4e5246a8d req-906d0f8f-90ee-433c-b1b8-850f7a5f95e6 service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7557d160-44dc-4622-baac-c3a4e5246a8d req-906d0f8f-90ee-433c-b1b8-850f7a5f95e6 service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7557d160-44dc-4622-baac-c3a4e5246a8d req-906d0f8f-90ee-433c-b1b8-850f7a5f95e6 service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-7557d160-44dc-4622-baac-c3a4e5246a8d req-906d0f8f-90ee-433c-b1b8-850f7a5f95e6 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:29 user nova-compute[75292]: WARNING nova.compute.manager [req-7557d160-44dc-4622-baac-c3a4e5246a8d req-906d0f8f-90ee-433c-b1b8-850f7a5f95e6 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received unexpected event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with vm_state building and task_state spawning.
Nov 14 15:01:29 user nova-compute[75292]: INFO nova.compute.manager [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Took 10.37 seconds to build instance.
Nov 14 15:01:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-db360a98-82d7-44bc-851e-b0b4bc5b8152 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.467s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:01:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:34 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:34 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8381MB free_disk=25.128925323486328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 72f698e5-c358-4a02-96f5-993a91ab969d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f3b39492-5aeb-4dc2-b8bc-27b941004926 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 8dbb1152-7cb7-447b-b71e-0202c3cae831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:01:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-changed-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Refreshing instance network info cache due to event network-changed-fae0661b-7e74-41ad-b544-59c26792f6cd. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] Acquiring lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] Acquired lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG nova.network.neutron [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Refreshing network info cache for port fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:40 user nova-compute[75292]: INFO nova.compute.manager [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Terminating instance
Nov 14 15:01:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Instance destroyed successfully.
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'resources' on Instance uuid 72f698e5-c358-4a02-96f5-993a91ab969d {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.network.neutron [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updated VIF entry in instance network info cache for port fae0661b-7e74-41ad-b544-59c26792f6cd. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.network.neutron [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating instance_info_cache with network_info: [{"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-788107834',display_name='tempest-TestStampPattern-server-788107834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-788107834',id=44,image_ref='34be275d-3a7c-4a6a-8e4f-b8ceb00b9ffe',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4X0bZ2E6lTaWCurq+vNQ7Eay1a1PgR3+amBQH2b8b5jqS2H83E4VO6gRrOd1s0X09OzYJn0hNdn8zkkqzW1XjZt3CYTTnX+OOgkotOanJ2EWGZB8tKp2PnXsl8eozlw==',key_name='tempest-TestStampPattern-2124283914',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:58:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b370479854d4135964bb1c3af954e96',ramdisk_id='',reservation_id='r-wkp9lpwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9b1e65d4-38d6-4959-8dda-40d33b83a895',image_min_disk='1',image_min_ram='0',image_owner_id='0b370479854d4135964bb1c3af954e96',image_owner_project_name='tempest-TestStampPattern-2069546202',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2069546202-project-member',image_user_id='480acd7147c34f58b39676cc2ec82397',owner_project_name='tempest-TestStampPattern-2069546202',owner_user_name='tempest-TestStampPattern-2069546202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:58:56Z,user_data=None,user_id='480acd7147c34f58b39676cc2ec82397',uuid=72f698e5-c358-4a02-96f5-993a91ab969d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converting VIF {"id": "fae0661b-7e74-41ad-b544-59c26792f6cd", "address": "fa:16:3e:aa:8b:5e", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfae0661b-7e", "ovs_interfaceid": "fae0661b-7e74-41ad-b544-59c26792f6cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG os_vif [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfae0661b-7e, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f7597c2f-0846-4eb4-b70e-03450fddc697 req-a3529a97-04e9-4eb5-bec7-62c51aa8a45f service nova] Releasing lock "refresh_cache-72f698e5-c358-4a02-96f5-993a91ab969d" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70af34df-fae1-4f9e-bfd9-9bc3af8c799a) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:41 user nova-compute[75292]: INFO os_vif [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:8b:5e,bridge_name='br-int',has_traffic_filtering=True,id=fae0661b-7e74-41ad-b544-59c26792f6cd,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfae0661b-7e')
Nov 14 15:01:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Deleting instance files /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d_del
Nov 14 15:01:41 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Deletion of /opt/stack/data/nova/instances/72f698e5-c358-4a02-96f5-993a91ab969d_del complete
Nov 14 15:01:41 user nova-compute[75292]: INFO nova.compute.manager [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 15:01:41 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:01:41 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:42 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Took 0.61 seconds to deallocate network for instance.
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:42 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Deleted allocations for instance 72f698e5-c358-4a02-96f5-993a91ab969d
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-a0bf07ad-0ffe-4523-a85a-5fff9c884d02 tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "72f698e5-c358-4a02-96f5-993a91ab969d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-vif-unplugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] No waiting events found dispatching network-vif-unplugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:42 user nova-compute[75292]: WARNING nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received unexpected event network-vif-unplugged-fae0661b-7e74-41ad-b544-59c26792f6cd for instance with vm_state deleted and task_state None.
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] Acquiring lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] Lock "72f698e5-c358-4a02-96f5-993a91ab969d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] No waiting events found dispatching network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:42 user nova-compute[75292]: WARNING nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received unexpected event network-vif-plugged-fae0661b-7e74-41ad-b544-59c26792f6cd for instance with vm_state deleted and task_state None.
Nov 14 15:01:42 user nova-compute[75292]: DEBUG nova.compute.manager [req-9ed34094-af83-4fda-be67-dd03dc0e8be9 req-ec7e729c-c2c7-419d-a77d-c0e850c3b63c service nova] [instance: 72f698e5-c358-4a02-96f5-993a91ab969d] Received event network-vif-deleted-fae0661b-7e74-41ad-b544-59c26792f6cd {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:01:52 user nova-compute[75292]: INFO nova.compute.claims [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Claim successful on node user
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:01:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.policy [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dbc24e3bc2446fb9c633b220a9de990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54ddffd17e449719cf8caaac639adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:01:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Creating image(s)
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:52 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk 1073741824" returned: 0 in 0.048s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Successfully created port: 1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Cannot resize image /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Ensure instance console log exists: /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:53 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Successfully updated port: 1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-changed-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Refreshing instance network info cache due to event network-changed-1d1841cb-e46c-4f74-b8a6-3880730a8b65. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.neutron [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance network_info: |[{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.neutron [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Refreshing network info cache for port 1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start _get_guest_xml network_info=[{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:01:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:01:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.objects.instance [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'pci_devices' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:01:54 user nova-compute[75292]:   <uuid>76608663-985f-4b5d-8634-1174fd598686</uuid>
Nov 14 15:01:54 user nova-compute[75292]:   <name>instance-00000030</name>
Nov 14 15:01:54 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:01:54 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:01:54 user nova-compute[75292]:   <metadata>
Nov 14 15:01:54 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:01:54 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:01:54 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeTestJSON-server-1460218955</nova:name>
Nov 14 15:01:54 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:01:54</nova:creationTime>
Nov 14 15:01:54 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:01:54 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:01:54 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:01:54 user nova-compute[75292]:       <nova:owner>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:user uuid="3dbc24e3bc2446fb9c633b220a9de990">tempest-AttachVolumeTestJSON-2139193622-project-member</nova:user>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:project uuid="e54ddffd17e449719cf8caaac639adc0">tempest-AttachVolumeTestJSON-2139193622</nova:project>
Nov 14 15:01:54 user nova-compute[75292]:       </nova:owner>
Nov 14 15:01:54 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:01:54 user nova-compute[75292]:       <nova:ports>
Nov 14 15:01:54 user nova-compute[75292]:         <nova:port uuid="1d1841cb-e46c-4f74-b8a6-3880730a8b65">
Nov 14 15:01:54 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 15:01:54 user nova-compute[75292]:         </nova:port>
Nov 14 15:01:54 user nova-compute[75292]:       </nova:ports>
Nov 14 15:01:54 user nova-compute[75292]:     </nova:instance>
Nov 14 15:01:54 user nova-compute[75292]:   </metadata>
Nov 14 15:01:54 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:01:54 user nova-compute[75292]:     <system>
Nov 14 15:01:54 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:01:54 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:01:54 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:01:54 user nova-compute[75292]:       <entry name="serial">76608663-985f-4b5d-8634-1174fd598686</entry>
Nov 14 15:01:54 user nova-compute[75292]:       <entry name="uuid">76608663-985f-4b5d-8634-1174fd598686</entry>
Nov 14 15:01:54 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:01:54 user nova-compute[75292]:     </system>
Nov 14 15:01:54 user nova-compute[75292]:   </sysinfo>
Nov 14 15:01:54 user nova-compute[75292]:   <os>
Nov 14 15:01:54 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:01:54 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:01:54 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:01:54 user nova-compute[75292]:   </os>
Nov 14 15:01:54 user nova-compute[75292]:   <features>
Nov 14 15:01:54 user nova-compute[75292]:     <acpi/>
Nov 14 15:01:54 user nova-compute[75292]:     <apic/>
Nov 14 15:01:54 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:01:54 user nova-compute[75292]:   </features>
Nov 14 15:01:54 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:01:54 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:01:54 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:01:54 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:01:54 user nova-compute[75292]:   </clock>
Nov 14 15:01:54 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:01:54 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:01:54 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:01:54 user nova-compute[75292]:   </cpu>
Nov 14 15:01:54 user nova-compute[75292]:   <devices>
Nov 14 15:01:54 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:01:54 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:01:54 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk"/>
Nov 14 15:01:54 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:01:54 user nova-compute[75292]:     </disk>
Nov 14 15:01:54 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:01:54 user nova-compute[75292]:       <mac address="fa:16:3e:f0:7c:7c"/>
Nov 14 15:01:54 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:01:54 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:01:54 user nova-compute[75292]:       <target dev="tap1d1841cb-e4"/>
Nov 14 15:01:54 user nova-compute[75292]:     </interface>
Nov 14 15:01:54 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:01:54 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/console.log" append="off"/>
Nov 14 15:01:54 user nova-compute[75292]:     </serial>
Nov 14 15:01:54 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:01:54 user nova-compute[75292]:     <video>
Nov 14 15:01:54 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:01:54 user nova-compute[75292]:     </video>
Nov 14 15:01:54 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:01:54 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:01:54 user nova-compute[75292]:     </rng>
Nov 14 15:01:54 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:01:54 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:01:54 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:01:54 user nova-compute[75292]:     </memballoon>
Nov 14 15:01:54 user nova-compute[75292]:   </devices>
Nov 14 15:01:54 user nova-compute[75292]: </domain>
Nov 14 15:01:54 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:01:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG os_vif [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28054bae-3494-571f-b176-89085bd4ff50', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d1841cb-e4, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d1841cb-e4, col_values=(('qos', UUID('53dcbdb6-a01e-45c9-9260-e39b0a6151da')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d1841cb-e4, col_values=(('external_ids', {'iface-id': '1d1841cb-e46c-4f74-b8a6-3880730a8b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:7c:7c', 'vm-uuid': '76608663-985f-4b5d-8634-1174fd598686'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:54 user nova-compute[75292]: INFO os_vif [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4')
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:01:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No VIF found with MAC fa:16:3e:f0:7c:7c, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:01:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated VIF entry in instance network info cache for port 1d1841cb-e46c-4f74-b8a6-3880730a8b65. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:01:55 user nova-compute[75292]: DEBUG nova.network.neutron [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:01:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-285ad6b3-0f6d-40b7-9553-ad67ae75cb5e req-ec679749-4c04-467a-ad93-d6695237bbd6 service nova] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:01:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-edb25fa9-ee3d-4afa-9aac-7471c8100e4e req-0ddf2b49-aedd-4c3d-81e4-fe9e43e1bdcc service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edb25fa9-ee3d-4afa-9aac-7471c8100e4e req-0ddf2b49-aedd-4c3d-81e4-fe9e43e1bdcc service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edb25fa9-ee3d-4afa-9aac-7471c8100e4e req-0ddf2b49-aedd-4c3d-81e4-fe9e43e1bdcc service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-edb25fa9-ee3d-4afa-9aac-7471c8100e4e req-0ddf2b49-aedd-4c3d-81e4-fe9e43e1bdcc service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-edb25fa9-ee3d-4afa-9aac-7471c8100e4e req-0ddf2b49-aedd-4c3d-81e4-fe9e43e1bdcc service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:56 user nova-compute[75292]: WARNING nova.compute.manager [req-edb25fa9-ee3d-4afa-9aac-7471c8100e4e req-0ddf2b49-aedd-4c3d-81e4-fe9e43e1bdcc service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state building and task_state spawning.
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-5beb087b-1c90-4f2a-bb75-4fafd5da5f58 req-16c5b3fe-c4c5-4412-8348-6f68014bfc1e service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5beb087b-1c90-4f2a-bb75-4fafd5da5f58 req-16c5b3fe-c4c5-4412-8348-6f68014bfc1e service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5beb087b-1c90-4f2a-bb75-4fafd5da5f58 req-16c5b3fe-c4c5-4412-8348-6f68014bfc1e service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5beb087b-1c90-4f2a-bb75-4fafd5da5f58 req-16c5b3fe-c4c5-4412-8348-6f68014bfc1e service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.compute.manager [req-5beb087b-1c90-4f2a-bb75-4fafd5da5f58 req-16c5b3fe-c4c5-4412-8348-6f68014bfc1e service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:01:58 user nova-compute[75292]: WARNING nova.compute.manager [req-5beb087b-1c90-4f2a-bb75-4fafd5da5f58 req-16c5b3fe-c4c5-4412-8348-6f68014bfc1e service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state building and task_state spawning.
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:01:58 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance spawned successfully.
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:01:58 user nova-compute[75292]: INFO nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 14 15:01:58 user nova-compute[75292]: DEBUG nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:01:58 user nova-compute[75292]: INFO nova.compute.manager [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Took 6.56 seconds to build instance.
Nov 14 15:01:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-1e73ad62-e24e-4f62-92a8-d6002e4fa068 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.645s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:01:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:02:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:02:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG nova.compute.manager [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG nova.compute.manager [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing instance network info cache due to event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG nova.network.neutron [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG nova.network.neutron [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updated VIF entry in instance network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG nova.network.neutron [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:02:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07cc9ac0-6533-4afb-a865-0cad10fea375 req-74d4b96d-9f07-4ef3-beeb-adb8d8b9a5e7 service nova] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:02:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:29 user nova-compute[75292]: INFO nova.compute.manager [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Shelving
Nov 14 15:02:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-07b8281d-4caa-40a4-86f7-40e53c84ea64 req-31479a68-8da2-4af4-b007-9a5fe02693da service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-unplugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07b8281d-4caa-40a4-86f7-40e53c84ea64 req-31479a68-8da2-4af4-b007-9a5fe02693da service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07b8281d-4caa-40a4-86f7-40e53c84ea64 req-31479a68-8da2-4af4-b007-9a5fe02693da service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-07b8281d-4caa-40a4-86f7-40e53c84ea64 req-31479a68-8da2-4af4-b007-9a5fe02693da service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-07b8281d-4caa-40a4-86f7-40e53c84ea64 req-31479a68-8da2-4af4-b007-9a5fe02693da service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-unplugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:02:29 user nova-compute[75292]: WARNING nova.compute.manager [req-07b8281d-4caa-40a4-86f7-40e53c84ea64 req-31479a68-8da2-4af4-b007-9a5fe02693da service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-unplugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state active and task_state shelving.
Nov 14 15:02:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance destroyed successfully.
Nov 14 15:02:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:30 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Beginning cold snapshot process
Nov 14 15:02:30 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 15:02:30 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk /opt/stack/data/nova/instances/snapshots/tmpskfmi19x/1425723260234265ae3759a490b87aa0 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk /opt/stack/data/nova/instances/snapshots/tmpskfmi19x/1425723260234265ae3759a490b87aa0" returned: 0 in 0.552s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:31 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Snapshot extracted, beginning image upload
Nov 14 15:02:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-8be1c2a5-4360-4504-bae8-612bd169256c req-7cd43502-6ad2-431b-a495-f3d5679530bb service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8be1c2a5-4360-4504-bae8-612bd169256c req-7cd43502-6ad2-431b-a495-f3d5679530bb service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8be1c2a5-4360-4504-bae8-612bd169256c req-7cd43502-6ad2-431b-a495-f3d5679530bb service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8be1c2a5-4360-4504-bae8-612bd169256c req-7cd43502-6ad2-431b-a495-f3d5679530bb service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG nova.compute.manager [req-8be1c2a5-4360-4504-bae8-612bd169256c req-7cd43502-6ad2-431b-a495-f3d5679530bb service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:02:31 user nova-compute[75292]: WARNING nova.compute.manager [req-8be1c2a5-4360-4504-bae8-612bd169256c req-7cd43502-6ad2-431b-a495-f3d5679530bb service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:31 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:02:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Snapshot image upload complete
Nov 14 15:02:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:02:33 user nova-compute[75292]: INFO nova.compute.manager [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Shelve offloading
Nov 14 15:02:33 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:02:33 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:02:33 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8328MB free_disk=25.023056030273438GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:33 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance destroyed successfully.
Nov 14 15:02:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 9b1e65d4-38d6-4959-8dda-40d33b83a895 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f3b39492-5aeb-4dc2-b8bc-27b941004926 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 8dbb1152-7cb7-447b-b71e-0202c3cae831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:02:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance destroyed successfully.
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'resources' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-499197565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-499197565',id=45,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAos6/ayEFBl8dK2N3yPu7sE42R3QPa2N2I2NH/mhQ9bMVFnf8ubKD7j2COPWKUvArA5joyHsDk0rqVbynbLzI6TSYXCm84JUcVJcZ8mSzo2UyTBaGT2j06wE+fmLe8Sg==',key_name='tempest-keypair-1317824269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-wc0iuf38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member',shelved_at='2023-11-14T15:02:33.560595',shelved_host='user',shelved_image_id='bc6373b6-b5ed-4185-9ba3-0b6d0a911679'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=f3b39492-5aeb-4dc2-b8bc-27b941004926,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG os_vif [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap172db38c-ba, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5b0e3c7-2556-49ee-b25c-2a61214bd901) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing instance network info cache due to event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.network.neutron [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:02:35 user nova-compute[75292]: INFO os_vif [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba')
Nov 14 15:02:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Deleting instance files /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926_del
Nov 14 15:02:35 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Deletion of /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926_del complete
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Deleted allocations for instance f3b39492-5aeb-4dc2-b8bc-27b941004926
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'numa_topology' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.objects.base [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<f3b39492-5aeb-4dc2-b8bc-27b941004926> lazy-loaded attributes: resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-changed-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.manager [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Refreshing instance network info cache due to event network-changed-0a6d4cce-e288-4be0-a978-dd4ff32f5173. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] Acquiring lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] Acquired lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.network.neutron [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Refreshing network info cache for port 0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:35 user nova-compute[75292]: INFO nova.compute.manager [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Terminating instance
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d747d48a-69db-4a22-a461-34a94e3572ae tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.226s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updated VIF entry in instance network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap172db38c-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c6a8374-54ba-4ca6-bf41-baa66d5ca36a req-4b0c8266-dc14-4103-801d-f68a03969db9 service nova] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updated VIF entry in instance network info cache for port 0a6d4cce-e288-4be0-a978-dd4ff32f5173. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.neutron [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating instance_info_cache with network_info: [{"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4ff548f2-8fa4-4a48-8b0e-09fc839af270 req-5450b868-1994-47fb-b1b4-755178e47d69 service nova] Releasing lock "refresh_cache-9b1e65d4-38d6-4959-8dda-40d33b83a895" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Instance destroyed successfully.
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.objects.instance [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lazy-loading 'resources' on Instance uuid 9b1e65d4-38d6-4959-8dda-40d33b83a895 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T14:55:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2088534401',display_name='tempest-TestStampPattern-server-2088534401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2088534401',id=41,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4X0bZ2E6lTaWCurq+vNQ7Eay1a1PgR3+amBQH2b8b5jqS2H83E4VO6gRrOd1s0X09OzYJn0hNdn8zkkqzW1XjZt3CYTTnX+OOgkotOanJ2EWGZB8tKp2PnXsl8eozlw==',key_name='tempest-TestStampPattern-2124283914',keypairs=<?>,launch_index=0,launched_at=2023-11-14T14:55:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b370479854d4135964bb1c3af954e96',ramdisk_id='',reservation_id='r-arukg9e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2069546202',owner_user_name='tempest-TestStampPattern-2069546202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T14:58:46Z,user_data=None,user_id='480acd7147c34f58b39676cc2ec82397',uuid=9b1e65d4-38d6-4959-8dda-40d33b83a895,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converting VIF {"id": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "address": "fa:16:3e:f2:16:10", "network": {"id": "63a2a869-baa2-488c-bc15-79e2c55219b6", "bridge": "br-int", "label": "tempest-TestStampPattern-1394200577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b370479854d4135964bb1c3af954e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6d4cce-e2", "ovs_interfaceid": "0a6d4cce-e288-4be0-a978-dd4ff32f5173", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG os_vif [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6d4cce-e2, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=852212b7-7f66-42b9-b7ae-773160cc5b64) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:02:36 user nova-compute[75292]: INFO os_vif [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:16:10,bridge_name='br-int',has_traffic_filtering=True,id=0a6d4cce-e288-4be0-a978-dd4ff32f5173,network=Network(63a2a869-baa2-488c-bc15-79e2c55219b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6d4cce-e2')
Nov 14 15:02:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Deleting instance files /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895_del
Nov 14 15:02:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Deletion of /opt/stack/data/nova/instances/9b1e65d4-38d6-4959-8dda-40d33b83a895_del complete
Nov 14 15:02:36 user nova-compute[75292]: INFO nova.compute.manager [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 15:02:36 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:02:36 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Took 0.51 seconds to deallocate network for instance.
Nov 14 15:02:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-78b7b513-cd64-49d3-9a76-988c18e5f3b0 req-64a27e71-c648-4a6a-8caa-3232a7e092f2 service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-vif-deleted-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:37 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Deleted allocations for instance 9b1e65d4-38d6-4959-8dda-40d33b83a895
Nov 14 15:02:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-vif-unplugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] No waiting events found dispatching network-vif-unplugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:02:37 user nova-compute[75292]: WARNING nova.compute.manager [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received unexpected event network-vif-unplugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 for instance with vm_state deleted and task_state None.
Nov 14 15:02:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received event network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] Acquiring lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:37 user nova-compute[75292]: DEBUG nova.compute.manager [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] No waiting events found dispatching network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:02:37 user nova-compute[75292]: WARNING nova.compute.manager [req-9096465b-85b3-4f16-8740-062570aa9ce0 req-6a06eb16-6781-4df5-8611-96dd82efb7bf service nova] [instance: 9b1e65d4-38d6-4959-8dda-40d33b83a895] Received unexpected event network-vif-plugged-0a6d4cce-e288-4be0-a978-dd4ff32f5173 for instance with vm_state deleted and task_state None.
Nov 14 15:02:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-cc13be8b-a330-414f-994c-e4a62d9589db tempest-TestStampPattern-2069546202 tempest-TestStampPattern-2069546202-project-member] Lock "9b1e65d4-38d6-4959-8dda-40d33b83a895" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:02:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:02:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:02:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:02:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:02:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:03:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-changed-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Refreshing instance network info cache due to event network-changed-312324fb-cd80-4558-adfb-d88d762d25fa. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] Acquiring lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] Acquired lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Refreshing network info cache for port 312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updated VIF entry in instance network info cache for port 312324fb-cd80-4558-adfb-d88d762d25fa. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updating instance_info_cache with network_info: [{"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:03:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-336977e4-cad6-42e2-9223-14098bb850a3 req-7ab52df9-5875-452d-a6fc-2dec82b0eb3a service nova] Releasing lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG nova.objects.instance [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:10 user nova-compute[75292]: INFO nova.compute.manager [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Attaching volume 3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 to /dev/vdb
Nov 14 15:03:10 user nova-compute[75292]: DEBUG os_brick.utils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61306f5-32cb-4021-b308-31558a22bb9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c553dd7-a6ef-4fde-95fa-3f616909057d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54c4d9d-9a2e-4e35-ae7b-f7ef8f108cab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0659bc8-62f6-4cd1-9be9-dfa298f62ea7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:03:10 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:03:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd4501d-2db6-4855-9bb6-2cc5440b8a26]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG os_brick.utils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:10 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updating existing volume attachment record: 8d5670ec-8efa-4403-90e2-6b20d7a450c9 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-changed-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Refreshing instance network info cache due to event network-changed-0eddc264-57d8-4aea-8c80-3c8b55af501f. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] Acquiring lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] Acquired lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Refreshing network info cache for port 0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updated VIF entry in instance network info cache for port 0eddc264-57d8-4aea-8c80-3c8b55af501f. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating instance_info_cache with network_info: [{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:03:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-08c650bf-ec1e-4947-b202-422e148c6bb6 req-c19a9f73-eb3e-44e4-bdaf-cb15b0ac872f service nova] Releasing lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAkOqNEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:15 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:15 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:15 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[206f92bf-8f67-4500-91b7-31d0207b987d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:03:15 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1155e10e-f83b-4a9b-bd2f-910996b7c954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1] added
Nov 14 15:03:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[42516ff7-b728-464d-a085-67c2a2fabfe9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:03:15 user nova-compute[75292]: INFO nova.compute.claims [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Claim successful on node user
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a711e1-d894-486a-b422-83a4fbd2b28f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAkOqNEW {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAkOqNEW" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[632745ac-4660-4f3d-980c-a9772033e9a8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAkOqNEW'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe0bab-dc96-4942-aa3c-8e77b1ea456e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e00dc3-978a-44ca-8246-2e47eb7e4654]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5240c8-b5fb-425a-ad96-cb5841b96ad3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260]
Nov 14 15:03:15 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260] successful.
Nov 14 15:03:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7034927-04a4-4a50-a7dd-27affdfc66d3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4db0fc-43f1-4549-b419-7d74dcf7c806]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:15 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:15 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:15 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a57d76b-a47b-4957-968a-31cdb50c4874]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAkOqNEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:03:15 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:03:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.policy [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '12846e84377c40998d795e5f0b09252f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cebd367820b4847b1f8b7c402a22ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:03:16 user nova-compute[75292]: INFO nova.virt.block_device [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Booting with volume 5663cc05-0363-4b88-9dba-88c0d983b90f at /dev/vda
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a646e-5b9a-4af1-b7fc-eda099078efc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a30b720-8ea3-41ca-a863-997b17371fb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d33ec-b778-4488-b1db-4063f802d0ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dedaab2-22d4-4cb8-8092-469e7b210e5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:03:16 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:03:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e21409c-d229-4f81-95b9-ae230d9aa5ba]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updating existing volume attachment record: b46b7782-54cf-4701-9441-6b8f62480015 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26565323731663334', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565323731663334', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:03:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:03:16 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:03:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:03:16 user nova-compute[75292]:   <serial>3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1</serial>
Nov 14 15:03:16 user nova-compute[75292]: </disk>
Nov 14 15:03:16 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Successfully created port: 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] No VIF found with MAC fa:16:3e:c9:5b:ef, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-43a3dc36-3e81-49ce-bd35-e599222b0749 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.125s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Successfully updated port: 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquired lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-changed-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.compute.manager [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Refreshing instance network info cache due to event network-changed-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] Acquiring lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:03:17 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updating instance_info_cache with network_info: [{"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Releasing lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Instance network_info: |[{"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] Acquired lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Refreshing network info cache for port 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:18 user nova-compute[75292]: INFO nova.compute.manager [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Detaching volume 3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1
Nov 14 15:03:18 user nova-compute[75292]: INFO nova.virt.block_device [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Attempting to driver detach volume 3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 from mountpoint /dev/vdb
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Attempting to detach device vdb from instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:03:18 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:03:18 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:03:18 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:03:18 user nova-compute[75292]:   <serial>3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1</serial>
Nov 14 15:03:18 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:03:18 user nova-compute[75292]: </disk>
Nov 14 15:03:18 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:03:18 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully detached device vdb from instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 from the persistent domain config.
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:03:18 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:03:18 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:03:18 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:03:18 user nova-compute[75292]:   <serial>3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1</serial>
Nov 14 15:03:18 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:03:18 user nova-compute[75292]: </disk>
Nov 14 15:03:18 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updated VIF entry in instance network info cache for port 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.network.neutron [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updating instance_info_cache with network_info: [{"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3dcd5888-518b-4544-ab43-3852a44fb74a req-2b5ea2b7-827a-4dd4-bb0c-cee365dc9450 service nova] Releasing lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:03:18 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:03:20 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Creating image(s)
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Did not create local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Ensure instance console log exists: /opt/stack/data/nova/instances/dd2fb582-aba1-4162-85cd-8bf001f4b548/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Start _get_guest_xml network_info=[{"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b46b7782-54cf-4701-9441-6b8f62480015', 'boot_index': 0, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PczBEIfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd2fb582-aba1-4162-85cd-8bf001f4b548', 'attached_at': '', 'detached_at': '', 'volume_id': '5663cc05-0363-4b88-9dba-88c0d983b90f', 'serial': '5663cc05-0363-4b88-9dba-88c0d983b90f'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:03:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:03:20 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:03:20 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PczBEIfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:21 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:21 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:21 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1b5075-9516-40b4-b16f-010f992e33a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:03:21 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d25b11-dec1-44a9-aba7-118194c08012]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f] added
Nov 14 15:03:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614037b-abe9-4a43-a39a-cb39f9d46ac3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e12cd1-4b75-48ce-927e-7bedd65ce6e9]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PczBEIfG {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PczBEIfG" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcced0fd-9f64-479e-8885-6e4d638c9dd0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PczBEIfG'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68b6268-77cc-459d-a16a-d000d211f385]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8b283-ded4-423e-be60-003ac723abe8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:21 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:21 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f883fa-8745-4feb-9cc4-edc0dfaab4e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260]
Nov 14 15:03:21 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260] successful.
Nov 14 15:03:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd420a-dd54-412f-b061-98aa29e5974f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c230b-c54c-487e-a741-06a21a698f52]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:21 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:21 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:21 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:21 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[83666f9f-3749-40e3-99d9-fd3e1934fd04]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PczBEIfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:03:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26364336339636137', 'path': '/dev/sdd'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364336339636137', 'path': '/dev/sdd'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-909612642',display_name='tempest-TestVolumeBootPattern-server-909612642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-909612642',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-5ho9ykns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:03:16Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=dd2fb582-aba1-4162-85cd-8bf001f4b548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.objects.instance [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'pci_devices' on Instance uuid dd2fb582-aba1-4162-85cd-8bf001f4b548 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:03:22 user nova-compute[75292]:   <uuid>dd2fb582-aba1-4162-85cd-8bf001f4b548</uuid>
Nov 14 15:03:22 user nova-compute[75292]:   <name>instance-00000031</name>
Nov 14 15:03:22 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:03:22 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:03:22 user nova-compute[75292]:   <metadata>
Nov 14 15:03:22 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:03:22 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:03:22 user nova-compute[75292]:       <nova:name>tempest-TestVolumeBootPattern-server-909612642</nova:name>
Nov 14 15:03:22 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:03:20</nova:creationTime>
Nov 14 15:03:22 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:03:22 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:03:22 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:03:22 user nova-compute[75292]:       <nova:owner>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:user uuid="12846e84377c40998d795e5f0b09252f">tempest-TestVolumeBootPattern-53606599-project-member</nova:user>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:project uuid="6cebd367820b4847b1f8b7c402a22ffc">tempest-TestVolumeBootPattern-53606599</nova:project>
Nov 14 15:03:22 user nova-compute[75292]:       </nova:owner>
Nov 14 15:03:22 user nova-compute[75292]:       <nova:ports>
Nov 14 15:03:22 user nova-compute[75292]:         <nova:port uuid="68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d">
Nov 14 15:03:22 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 15:03:22 user nova-compute[75292]:         </nova:port>
Nov 14 15:03:22 user nova-compute[75292]:       </nova:ports>
Nov 14 15:03:22 user nova-compute[75292]:     </nova:instance>
Nov 14 15:03:22 user nova-compute[75292]:   </metadata>
Nov 14 15:03:22 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:03:22 user nova-compute[75292]:     <system>
Nov 14 15:03:22 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:03:22 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:03:22 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:03:22 user nova-compute[75292]:       <entry name="serial">dd2fb582-aba1-4162-85cd-8bf001f4b548</entry>
Nov 14 15:03:22 user nova-compute[75292]:       <entry name="uuid">dd2fb582-aba1-4162-85cd-8bf001f4b548</entry>
Nov 14 15:03:22 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:03:22 user nova-compute[75292]:     </system>
Nov 14 15:03:22 user nova-compute[75292]:   </sysinfo>
Nov 14 15:03:22 user nova-compute[75292]:   <os>
Nov 14 15:03:22 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:03:22 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:03:22 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:03:22 user nova-compute[75292]:   </os>
Nov 14 15:03:22 user nova-compute[75292]:   <features>
Nov 14 15:03:22 user nova-compute[75292]:     <acpi/>
Nov 14 15:03:22 user nova-compute[75292]:     <apic/>
Nov 14 15:03:22 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:03:22 user nova-compute[75292]:   </features>
Nov 14 15:03:22 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:03:22 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:03:22 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:03:22 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:03:22 user nova-compute[75292]:   </clock>
Nov 14 15:03:22 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:03:22 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:03:22 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:03:22 user nova-compute[75292]:   </cpu>
Nov 14 15:03:22 user nova-compute[75292]:   <devices>
Nov 14 15:03:22 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 15:03:22 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:03:22 user nova-compute[75292]:       <source dev="/dev/sdd"/>
Nov 14 15:03:22 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:03:22 user nova-compute[75292]:       <serial>5663cc05-0363-4b88-9dba-88c0d983b90f</serial>
Nov 14 15:03:22 user nova-compute[75292]:     </disk>
Nov 14 15:03:22 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:03:22 user nova-compute[75292]:       <mac address="fa:16:3e:5d:ee:b8"/>
Nov 14 15:03:22 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:03:22 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:03:22 user nova-compute[75292]:       <target dev="tap68698dd9-6e"/>
Nov 14 15:03:22 user nova-compute[75292]:     </interface>
Nov 14 15:03:22 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:03:22 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/dd2fb582-aba1-4162-85cd-8bf001f4b548/console.log" append="off"/>
Nov 14 15:03:22 user nova-compute[75292]:     </serial>
Nov 14 15:03:22 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:03:22 user nova-compute[75292]:     <video>
Nov 14 15:03:22 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:03:22 user nova-compute[75292]:     </video>
Nov 14 15:03:22 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:03:22 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:03:22 user nova-compute[75292]:     </rng>
Nov 14 15:03:22 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:03:22 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:03:22 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:03:22 user nova-compute[75292]:     </memballoon>
Nov 14 15:03:22 user nova-compute[75292]:   </devices>
Nov 14 15:03:22 user nova-compute[75292]: </domain>
Nov 14 15:03:22 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-909612642',display_name='tempest-TestVolumeBootPattern-server-909612642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-909612642',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-5ho9ykns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:03:16Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=dd2fb582-aba1-4162-85cd-8bf001f4b548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG os_vif [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05eda7e5-8b4e-5b20-b218-416f2f5ffcc7', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68698dd9-6e, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68698dd9-6e, col_values=(('qos', UUID('7135d09d-800d-44db-a865-59ec46245c7b')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68698dd9-6e, col_values=(('external_ids', {'iface-id': '68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ee:b8', 'vm-uuid': 'dd2fb582-aba1-4162-85cd-8bf001f4b548'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:22 user nova-compute[75292]: INFO os_vif [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e')
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:03:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] No VIF found with MAC fa:16:3e:5d:ee:b8, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:03:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:23 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-7fd001cc-d9e4-4a90-874b-3b27692cb542 req-514cf843-ad68-453f-866c-cf07e4e8505e service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7fd001cc-d9e4-4a90-874b-3b27692cb542 req-514cf843-ad68-453f-866c-cf07e4e8505e service nova] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7fd001cc-d9e4-4a90-874b-3b27692cb542 req-514cf843-ad68-453f-866c-cf07e4e8505e service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7fd001cc-d9e4-4a90-874b-3b27692cb542 req-514cf843-ad68-453f-866c-cf07e4e8505e service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-7fd001cc-d9e4-4a90-874b-3b27692cb542 req-514cf843-ad68-453f-866c-cf07e4e8505e service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] No waiting events found dispatching network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:24 user nova-compute[75292]: WARNING nova.compute.manager [req-7fd001cc-d9e4-4a90-874b-3b27692cb542 req-514cf843-ad68-453f-866c-cf07e4e8505e service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received unexpected event network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d for instance with vm_state building and task_state spawning.
Nov 14 15:03:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:03:25 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Instance spawned successfully.
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:03:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:26 user nova-compute[75292]: INFO nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 14 15:03:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-ce54804c-043d-4724-a14e-c7829e6861bb req-3d60f6c8-8bd8-4aae-8797-d7b892397347 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ce54804c-043d-4724-a14e-c7829e6861bb req-3d60f6c8-8bd8-4aae-8797-d7b892397347 service nova] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ce54804c-043d-4724-a14e-c7829e6861bb req-3d60f6c8-8bd8-4aae-8797-d7b892397347 service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ce54804c-043d-4724-a14e-c7829e6861bb req-3d60f6c8-8bd8-4aae-8797-d7b892397347 service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-ce54804c-043d-4724-a14e-c7829e6861bb req-3d60f6c8-8bd8-4aae-8797-d7b892397347 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] No waiting events found dispatching network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:26 user nova-compute[75292]: WARNING nova.compute.manager [req-ce54804c-043d-4724-a14e-c7829e6861bb req-3d60f6c8-8bd8-4aae-8797-d7b892397347 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received unexpected event network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d for instance with vm_state building and task_state spawning.
Nov 14 15:03:26 user nova-compute[75292]: INFO nova.compute.manager [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Took 10.44 seconds to build instance.
Nov 14 15:03:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-6cf6b7df-b7c6-453d-8b9a-9fdf3d018ce6 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.542s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updating instance_info_cache with network_info: [{"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-ec5a27b8-5266-40b8-bcb9-6de4cc33a511" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:03:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:03:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:03:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:34 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:35 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:03:35 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8474MB free_disk=25.157695770263672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 8dbb1152-7cb7-447b-b71e-0202c3cae831 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance dd2fb582-aba1-4162-85cd-8bf001f4b548 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:03:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:38 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 is timed out.
Nov 14 15:03:38 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully detached device vdb from instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511 from the live domain config.
Nov 14 15:03:38 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAkOqNEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:38 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2e9fa2-098c-455c-a7b7-963063a20094]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:03:38 user nova-compute[75292]: No targets found.
Nov 14 15:03:38 user nova-compute[75292]: iSNS:
Nov 14 15:03:38 user nova-compute[75292]: No targets found.
Nov 14 15:03:38 user nova-compute[75292]: STATIC:
Nov 14 15:03:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1
Nov 14 15:03:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:03:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:03:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 15:03:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:03:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:03:38 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f
Nov 14 15:03:38 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:03:38 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:03:38 user nova-compute[75292]: FIRMWARE:
Nov 14 15:03:38 user nova-compute[75292]: No targets found.
Nov 14 15:03:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:03:38 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:03:38 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52c343f-5705-4cbd-9609-8f20428443d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4e6c1-2b22-4ed5-bae1-57214b7da8ff]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:38 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:38 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:38 user nova-compute[75292]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 (non-flash)
Nov 14 15:03:38 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542b1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c7e998-b0c0-4faa-a4d4-094c95fbf56d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd69e61-3b25-4dc7-b464-eae0ae187586]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a621a-fb6b-4649-9a5b-23787b383b20]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7dc005-e661-48e2-b4f7-9aab112f5798]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[90762aef-5cee-4783-a150-85e554891237]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.245s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acbf675-5acc-44b5-b919-9e99164c1ac9]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260]
Nov 14 15:03:39 user nova-compute[75292]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1, portal: 172.16.0.220,3260] successful.
Nov 14 15:03:39 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f6c1d58-e4b0-4ad7-a7ba-f384d7ac3db1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9f9dc1-28e8-446e-b23a-14c46e5f1cad]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.488s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] <== disconnect_volume: return (489ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:03:40 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'flavor' on Instance uuid ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e571de90-0d63-461e-9c56-127289d176e9 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:03:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-changed-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG nova.compute.manager [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Refreshing instance network info cache due to event network-changed-1d1841cb-e46c-4f74-b8a6-3880730a8b65. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Refreshing network info cache for port 1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated VIF entry in instance network info cache for port 1d1841cb-e46c-4f74-b8a6-3880730a8b65. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG nova.network.neutron [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:03:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9062d750-a38f-4141-958b-4f84f6ca0684 req-921b334f-e864-4dd2-b4f4-e315bd4dc122 service nova] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:45 user nova-compute[75292]: INFO nova.compute.manager [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Attaching volume 4cc39d74-4533-40cb-9c7a-f571ad8d395e to /dev/vdb
Nov 14 15:03:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG os_brick.utils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0906cf2-fe8b-4f94-82e3-e8e588fc902c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61c4c9d-bef5-44f6-9b9e-c6117ae84bd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe7f4c6-fc01-43a3-8191-6b105f2e46de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[710a0808-3c9f-4908-ac93-d3f2a47dbd6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:03:45 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:03:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14af3ab7-bad3-4014-81eb-d586435825c9]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG os_brick.utils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:45 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating existing volume attachment record: f44e9f87-a2ae-4f5d-9142-b064703739bf {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:03:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:03:49 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:49 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:03:49 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[77115ae0-062f-47b4-a526-c57685b57c0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:03:49 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1800af-2784-482b-a748-911c9faecd7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e] added
Nov 14 15:03:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1793ee-7247-43e2-999f-ca9d9944a31d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc288322-67af-443b-a3c8-09b083f795ef]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqGJVTL {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqGJVTL" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0bf405-f593-4ed9-be51-2e1868549f1a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOqGJVTL'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c835e833-d947-49bf-ac27-603ad428525a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a97c32-8cdd-4af4-9606-ada2b0631e59]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:49 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:49 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[920812a2-9a3b-4bff-a42c-6fd73e41a4cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]
Nov 14 15:03:49 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.
Nov 14 15:03:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea60425a-e941-48fe-a5d5-227afb7aa4be]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[faabcbfb-e2bf-4d74-b010-012c2c506737]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:49 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:49 user nova-compute[75292]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:03:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:03:49 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:03:49 user nova-compute[75292]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:03:49 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:03:49 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:03:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:03:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:03:50 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff03ad1-2639-41ee-975f-6aa49ea2eac6]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:03:50 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:03:50 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:03:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26262646338656566', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262646338656566', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:03:51 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:03:51 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:03:51 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:03:51 user nova-compute[75292]:   <serial>4cc39d74-4533-40cb-9c7a-f571ad8d395e</serial>
Nov 14 15:03:51 user nova-compute[75292]: </disk>
Nov 14 15:03:51 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No VIF found with MAC fa:16:3e:f0:7c:7c, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e82e9d93-fd0a-4eec-9bdf-61145b074e96 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.313s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75292) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 15:03:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-3a4566fd-d100-4495-a897-115a947b8ff4 req-ab0042c7-45b1-4ccb-a929-9a9a551e5fdd service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3a4566fd-d100-4495-a897-115a947b8ff4 req-ab0042c7-45b1-4ccb-a929-9a9a551e5fdd service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3a4566fd-d100-4495-a897-115a947b8ff4 req-ab0042c7-45b1-4ccb-a929-9a9a551e5fdd service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3a4566fd-d100-4495-a897-115a947b8ff4 req-ab0042c7-45b1-4ccb-a929-9a9a551e5fdd service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-3a4566fd-d100-4495-a897-115a947b8ff4 req-ab0042c7-45b1-4ccb-a929-9a9a551e5fdd service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:52 user nova-compute[75292]: WARNING nova.compute.manager [req-3a4566fd-d100-4495-a897-115a947b8ff4 req-ab0042c7-45b1-4ccb-a929-9a9a551e5fdd service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state active and task_state powering-off.
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance destroyed successfully.
Nov 14 15:03:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-2b57557b-fbf3-4098-9836-f2572c5196a4 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.880s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:54 user nova-compute[75292]: WARNING nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state None.
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:54 user nova-compute[75292]: WARNING nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state None.
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:54 user nova-compute[75292]: WARNING nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state None.
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:54 user nova-compute[75292]: WARNING nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state None.
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:03:54 user nova-compute[75292]: DEBUG nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:03:54 user nova-compute[75292]: WARNING nova.compute.manager [req-f88b912f-2d9a-42bf-9b10-0cc60370a385 req-d70b4131-4a16-4a14-941c-b0404307d17a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state None.
Nov 14 15:03:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:03:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:08 user nova-compute[75292]: INFO nova.compute.manager [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Terminating instance
Nov 14 15:04:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-65495b70-0c1b-4123-9b4a-85668bda337b req-e5953666-a713-4d29-be6e-d09ca01f2e68 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-vif-unplugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-65495b70-0c1b-4123-9b4a-85668bda337b req-e5953666-a713-4d29-be6e-d09ca01f2e68 service nova] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-65495b70-0c1b-4123-9b4a-85668bda337b req-e5953666-a713-4d29-be6e-d09ca01f2e68 service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-65495b70-0c1b-4123-9b4a-85668bda337b req-e5953666-a713-4d29-be6e-d09ca01f2e68 service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-65495b70-0c1b-4123-9b4a-85668bda337b req-e5953666-a713-4d29-be6e-d09ca01f2e68 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] No waiting events found dispatching network-vif-unplugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:04:08 user nova-compute[75292]: DEBUG nova.compute.manager [req-65495b70-0c1b-4123-9b4a-85668bda337b req-e5953666-a713-4d29-be6e-d09ca01f2e68 service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-vif-unplugged-312324fb-cd80-4558-adfb-d88d762d25fa for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:04:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Instance destroyed successfully.
Nov 14 15:04:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lazy-loading 'resources' on Instance uuid ec5a27b8-5266-40b8-bcb9-6de4cc33a511 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1305627516',display_name='tempest-AttachVolumeNegativeTest-server-1305627516',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1305627516',id=46,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhpMh/RvGVZ+muP3/yNzMqqX+ixdNKdfU4mLiIAmLT407BM+E6VN5IRRdKjZHsmQRfdN672c15omMmV/zU9z7zHl4W5mShWsbK3c8zySzm1+asMJetLiVvRMamtU6tneg==',key_name='tempest-keypair-1592721271',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ae1d477a1d84afeb07533cddfe992d1',ramdisk_id='',reservation_id='r-oa0q86la',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-547312228',owner_user_name='tempest-AttachVolumeNegativeTest-547312228-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:01:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a7efbb426e4b558031f14a751e102b',uuid=ec5a27b8-5266-40b8-bcb9-6de4cc33a511,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converting VIF {"id": "312324fb-cd80-4558-adfb-d88d762d25fa", "address": "fa:16:3e:c9:5b:ef", "network": {"id": "f9bbcd0a-11a0-426b-a664-7f9a839927d2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-67714325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ae1d477a1d84afeb07533cddfe992d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap312324fb-cd", "ovs_interfaceid": "312324fb-cd80-4558-adfb-d88d762d25fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG os_vif [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap312324fb-cd, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60d40593-28c4-471b-b9bb-616f7c4c382e) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:09 user nova-compute[75292]: INFO os_vif [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:5b:ef,bridge_name='br-int',has_traffic_filtering=True,id=312324fb-cd80-4558-adfb-d88d762d25fa,network=Network(f9bbcd0a-11a0-426b-a664-7f9a839927d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap312324fb-cd')
Nov 14 15:04:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Deleting instance files /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511_del
Nov 14 15:04:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Deletion of /opt/stack/data/nova/instances/ec5a27b8-5266-40b8-bcb9-6de4cc33a511_del complete
Nov 14 15:04:09 user nova-compute[75292]: INFO nova.compute.manager [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 15:04:09 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:04:09 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:04:10 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Took 0.78 seconds to deallocate network for instance.
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:10 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Deleted allocations for instance ec5a27b8-5266-40b8-bcb9-6de4cc33a511
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-62db5709-b224-405f-b885-41fa4811a854 tempest-AttachVolumeNegativeTest-547312228 tempest-AttachVolumeNegativeTest-547312228-project-member] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.066s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] Acquiring lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] Lock "ec5a27b8-5266-40b8-bcb9-6de4cc33a511-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] No waiting events found dispatching network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:04:10 user nova-compute[75292]: WARNING nova.compute.manager [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received unexpected event network-vif-plugged-312324fb-cd80-4558-adfb-d88d762d25fa for instance with vm_state deleted and task_state None.
Nov 14 15:04:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-6b646cd4-89e8-467c-a781-23922de95b6f req-8286fc44-8520-4fac-b354-213010079fee service nova] [instance: ec5a27b8-5266-40b8-bcb9-6de4cc33a511] Received event network-vif-deleted-312324fb-cd80-4558-adfb-d88d762d25fa {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:04:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:22 user nova-compute[75292]: INFO nova.compute.manager [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Unshelving
Nov 14 15:04:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'pci_requests' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'numa_topology' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:04:22 user nova-compute[75292]: INFO nova.compute.claims [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Claim successful on node user
Nov 14 15:04:22 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:22 user nova-compute[75292]: INFO nova.network.neutron [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating port 172db38c-ba90-4c26-b1c1-a04f904da4d1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:22 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing instance network info cache due to event network-changed-172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] Acquiring lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.network.neutron [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:04:23 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Creating image(s)
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'trusted_certs' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] Acquired lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.network.neutron [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Refreshing network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG nova.objects.base [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<f3b39492-5aeb-4dc2-b8bc-27b941004926> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "509f52b4a261c6ef7a3812d6697d86a11e1303ac" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "509f52b4a261c6ef7a3812d6697d86a11e1303ac" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.part --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG nova.virt.images [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] bc6373b6-b5ed-4185-9ba3-0b6d0a911679 was qcow2, converting to raw {{(pid=75292) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG nova.privsep.utils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75292) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.part /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.converted {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updated VIF entry in instance network info cache for port 172db38c-ba90-4c26-b1c1-a04f904da4d1. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:04:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9c187190-d132-49fd-9c6c-a38d9b988b76 req-ff901aab-4eb8-4013-86b9-615ae66f321b service nova] Releasing lock "refresh_cache-f3b39492-5aeb-4dc2-b8bc-27b941004926" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.part /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.converted" returned: 0 in 0.589s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.converted --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "509f52b4a261c6ef7a3812d6697d86a11e1303ac" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.016s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "509f52b4a261c6ef7a3812d6697d86a11e1303ac" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "509f52b4a261c6ef7a3812d6697d86a11e1303ac" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac,backing_fmt=raw /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac,backing_fmt=raw /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk 1073741824" returned: 0 in 0.057s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "509f52b4a261c6ef7a3812d6697d86a11e1303ac" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:26 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'migration_context' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:26 user nova-compute[75292]: DEBUG nova.objects.base [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<f3b39492-5aeb-4dc2-b8bc-27b941004926> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:04:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Rebasing disk image.
Nov 14 15:04:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:26 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b -F raw /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:04:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:04:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:04:27 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating instance_info_cache with network_info: [{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b -F raw /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk" returned: 0 in 2.232s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Ensure instance console log exists: /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Start _get_guest_xml network_info=[{"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='74806ca35267a51957dd7883e1626e99',container_format='bare',created_at=2023-11-14T15:02:29Z,direct_url=<?>,disk_format='qcow2',id=bc6373b6-b5ed-4185-9ba3-0b6d0a911679,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-499197565-shelved',owner='3f7526301dd346a9a6f3367417755a67',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T15:02:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:04:28 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:04:28 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='74806ca35267a51957dd7883e1626e99',container_format='bare',created_at=2023-11-14T15:02:29Z,direct_url=<?>,disk_format='qcow2',id=bc6373b6-b5ed-4185-9ba3-0b6d0a911679,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-499197565-shelved',owner='3f7526301dd346a9a6f3367417755a67',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T15:02:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'vcpu_model' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.objects.base [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<f3b39492-5aeb-4dc2-b8bc-27b941004926> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-499197565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-499197565',id=45,image_ref='bc6373b6-b5ed-4185-9ba3-0b6d0a911679',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1317824269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-wc0iuf38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member',shelved_at='2023-11-14T15:02:33.560595',shelved_host='user',shelved_image_id='bc6373b6-b5ed-4185-9ba3-0b6d0a911679'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=f3b39492-5aeb-4dc2-b8bc-27b941004926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'pci_devices' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.objects.base [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Object Instance<f3b39492-5aeb-4dc2-b8bc-27b941004926> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:04:28 user nova-compute[75292]:   <uuid>f3b39492-5aeb-4dc2-b8bc-27b941004926</uuid>
Nov 14 15:04:28 user nova-compute[75292]:   <name>instance-0000002d</name>
Nov 14 15:04:28 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:04:28 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:04:28 user nova-compute[75292]:   <metadata>
Nov 14 15:04:28 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:04:28 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:04:28 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-499197565</nova:name>
Nov 14 15:04:28 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:04:28</nova:creationTime>
Nov 14 15:04:28 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:04:28 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:04:28 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:04:28 user nova-compute[75292]:       <nova:owner>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:user uuid="4b3312b416c74d92ae45d7edb5c08512">tempest-AttachVolumeShelveTestJSON-2139265145-project-member</nova:user>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:project uuid="3f7526301dd346a9a6f3367417755a67">tempest-AttachVolumeShelveTestJSON-2139265145</nova:project>
Nov 14 15:04:28 user nova-compute[75292]:       </nova:owner>
Nov 14 15:04:28 user nova-compute[75292]:       <nova:root type="image" uuid="bc6373b6-b5ed-4185-9ba3-0b6d0a911679"/>
Nov 14 15:04:28 user nova-compute[75292]:       <nova:ports>
Nov 14 15:04:28 user nova-compute[75292]:         <nova:port uuid="172db38c-ba90-4c26-b1c1-a04f904da4d1">
Nov 14 15:04:28 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 15:04:28 user nova-compute[75292]:         </nova:port>
Nov 14 15:04:28 user nova-compute[75292]:       </nova:ports>
Nov 14 15:04:28 user nova-compute[75292]:     </nova:instance>
Nov 14 15:04:28 user nova-compute[75292]:   </metadata>
Nov 14 15:04:28 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:04:28 user nova-compute[75292]:     <system>
Nov 14 15:04:28 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:04:28 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:04:28 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:04:28 user nova-compute[75292]:       <entry name="serial">f3b39492-5aeb-4dc2-b8bc-27b941004926</entry>
Nov 14 15:04:28 user nova-compute[75292]:       <entry name="uuid">f3b39492-5aeb-4dc2-b8bc-27b941004926</entry>
Nov 14 15:04:28 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:04:28 user nova-compute[75292]:     </system>
Nov 14 15:04:28 user nova-compute[75292]:   </sysinfo>
Nov 14 15:04:28 user nova-compute[75292]:   <os>
Nov 14 15:04:28 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:04:28 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:04:28 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:04:28 user nova-compute[75292]:   </os>
Nov 14 15:04:28 user nova-compute[75292]:   <features>
Nov 14 15:04:28 user nova-compute[75292]:     <acpi/>
Nov 14 15:04:28 user nova-compute[75292]:     <apic/>
Nov 14 15:04:28 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:04:28 user nova-compute[75292]:   </features>
Nov 14 15:04:28 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:04:28 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:04:28 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:04:28 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:04:28 user nova-compute[75292]:   </clock>
Nov 14 15:04:28 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:04:28 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:04:28 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:04:28 user nova-compute[75292]:   </cpu>
Nov 14 15:04:28 user nova-compute[75292]:   <devices>
Nov 14 15:04:28 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:04:28 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:04:28 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk"/>
Nov 14 15:04:28 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:04:28 user nova-compute[75292]:     </disk>
Nov 14 15:04:28 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:04:28 user nova-compute[75292]:       <mac address="fa:16:3e:d7:d6:d3"/>
Nov 14 15:04:28 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:04:28 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:04:28 user nova-compute[75292]:       <target dev="tap172db38c-ba"/>
Nov 14 15:04:28 user nova-compute[75292]:     </interface>
Nov 14 15:04:28 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:04:28 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/console.log" append="off"/>
Nov 14 15:04:28 user nova-compute[75292]:     </serial>
Nov 14 15:04:28 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:04:28 user nova-compute[75292]:     <video>
Nov 14 15:04:28 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:04:28 user nova-compute[75292]:     </video>
Nov 14 15:04:28 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:04:28 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:04:28 user nova-compute[75292]:     </rng>
Nov 14 15:04:28 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:04:28 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:04:28 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:04:28 user nova-compute[75292]:     </memballoon>
Nov 14 15:04:28 user nova-compute[75292]:   </devices>
Nov 14 15:04:28 user nova-compute[75292]: </domain>
Nov 14 15:04:28 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-499197565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-499197565',id=45,image_ref='bc6373b6-b5ed-4185-9ba3-0b6d0a911679',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1317824269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-wc0iuf38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member',shelved_at='2023-11-14T15:02:33.560595',shelved_host='user',shelved_image_id='bc6373b6-b5ed-4185-9ba3-0b6d0a911679'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=f3b39492-5aeb-4dc2-b8bc-27b941004926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG os_vif [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef90a5b2-bc0b-5469-8df2-55904f56d0ca', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap172db38c-ba, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap172db38c-ba, col_values=(('qos', UUID('cbb9dbc6-0add-4ed5-9107-6dc6b410f413')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap172db38c-ba, col_values=(('external_ids', {'iface-id': '172db38c-ba90-4c26-b1c1-a04f904da4d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:d6:d3', 'vm-uuid': 'f3b39492-5aeb-4dc2-b8bc-27b941004926'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:28 user nova-compute[75292]: INFO os_vif [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba')
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:04:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] No VIF found with MAC fa:16:3e:d7:d6:d3, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:04:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-af76e194-5436-4f91-a5f9-0a78f7568c4d req-d53f8438-be9f-4784-8063-d29b2875a7eb service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af76e194-5436-4f91-a5f9-0a78f7568c4d req-d53f8438-be9f-4784-8063-d29b2875a7eb service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af76e194-5436-4f91-a5f9-0a78f7568c4d req-d53f8438-be9f-4784-8063-d29b2875a7eb service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-af76e194-5436-4f91-a5f9-0a78f7568c4d req-d53f8438-be9f-4784-8063-d29b2875a7eb service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-af76e194-5436-4f91-a5f9-0a78f7568c4d req-d53f8438-be9f-4784-8063-d29b2875a7eb service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:04:30 user nova-compute[75292]: WARNING nova.compute.manager [req-af76e194-5436-4f91-a5f9-0a78f7568c4d req-d53f8438-be9f-4784-8063-d29b2875a7eb service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:04:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance spawned successfully.
Nov 14 15:04:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-dcfd0aed-c4dc-42ac-85ba-779e9b5d8b84 req-d0f2f8db-8487-492b-818a-e357b6584645 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dcfd0aed-c4dc-42ac-85ba-779e9b5d8b84 req-d0f2f8db-8487-492b-818a-e357b6584645 service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dcfd0aed-c4dc-42ac-85ba-779e9b5d8b84 req-d0f2f8db-8487-492b-818a-e357b6584645 service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-dcfd0aed-c4dc-42ac-85ba-779e9b5d8b84 req-d0f2f8db-8487-492b-818a-e357b6584645 service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG nova.compute.manager [req-dcfd0aed-c4dc-42ac-85ba-779e9b5d8b84 req-d0f2f8db-8487-492b-818a-e357b6584645 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:04:32 user nova-compute[75292]: WARNING nova.compute.manager [req-dcfd0aed-c4dc-42ac-85ba-779e9b5d8b84 req-d0f2f8db-8487-492b-818a-e357b6584645 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 15:04:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:04:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4d29a85a-49d2-44ac-afbd-95bdcff82749 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.396s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:04:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:34 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:04:35 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:04:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:04:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.15072250366211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 8dbb1152-7cb7-447b-b71e-0202c3cae831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance dd2fb582-aba1-4162-85cd-8bf001f4b548 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f3b39492-5aeb-4dc2-b8bc-27b941004926 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:04:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:04:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:04:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 15:04:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 15:04:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:04:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-changed-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Refreshing instance network info cache due to event network-changed-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:05:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] Acquiring lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:05:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] Acquired lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:05:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Refreshing network info cache for port 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:05:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updated VIF entry in instance network info cache for port 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:05:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updating instance_info_cache with network_info: [{"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:05:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8fa21417-bc31-4709-869c-1b2ccd8b3ecf req-9d8b5527-d9cf-4142-acec-12832188cf65 service nova] Releasing lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:05:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-changed-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.compute.manager [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Refreshing instance network info cache due to event network-changed-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] Acquiring lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] Acquired lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Refreshing network info cache for port 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:09 user nova-compute[75292]: INFO nova.compute.manager [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Terminating instance
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updated VIF entry in instance network info cache for port 68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.network.neutron [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updating instance_info_cache with network_info: [{"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-24d2894a-3037-4519-b443-e8df19227a48 req-21f816d3-ec75-4e0f-95bf-50d8292ef473 service nova] Releasing lock "refresh_cache-dd2fb582-aba1-4162-85cd-8bf001f4b548" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:05:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Instance destroyed successfully.
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'resources' on Instance uuid dd2fb582-aba1-4162-85cd-8bf001f4b548 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-909612642',display_name='tempest-TestVolumeBootPattern-server-909612642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-909612642',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-5ho9ykns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:03:26Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=dd2fb582-aba1-4162-85cd-8bf001f4b548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "address": "fa:16:3e:5d:ee:b8", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68698dd9-6e", "ovs_interfaceid": "68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG os_vif [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68698dd9-6e, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7135d09d-800d-44db-a865-59ec46245c7b) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:10 user nova-compute[75292]: INFO os_vif [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ee:b8,bridge_name='br-int',has_traffic_filtering=True,id=68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68698dd9-6e')
Nov 14 15:05:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PczBEIfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:05:10 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9754bb3-7944-4589-a34d-d30355c19072]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:05:10 user nova-compute[75292]: No targets found.
Nov 14 15:05:10 user nova-compute[75292]: iSNS:
Nov 14 15:05:10 user nova-compute[75292]: No targets found.
Nov 14 15:05:10 user nova-compute[75292]: STATIC:
Nov 14 15:05:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e
Nov 14 15:05:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:05:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:05:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 15:05:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:05:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:05:10 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f
Nov 14 15:05:10 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:05:10 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:05:10 user nova-compute[75292]: FIRMWARE:
Nov 14 15:05:10 user nova-compute[75292]: No targets found.
Nov 14 15:05:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:05:10 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:05:10 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d566c128-b691-4f18-a2f2-098f6d7f044f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[11547eef-e1e0-4e40-b91b-032f41cbbfbe]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:10 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:05:10 user nova-compute[75292]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:05:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:10 user nova-compute[75292]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f (non-flash)
Nov 14 15:05:10 user nova-compute[75292]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:05:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b542c2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f'): ({'sdd'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Removing single pathed devices sdd {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6eafb-49c4-476d-b475-9a5dd60d2cb1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa6512b-850a-490b-84a7-aa6f1c9d8f42]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flushing IO for device /dev/sdd {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeda4d27-cd30-4679-8e07-99204cdfe8d5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa3a30-566e-41a1-92c5-512b7f9027ed]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] SCSI volumes sdd have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3c292a9f-cd3c9ca756fd976a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c292a9f', '/dev/disk/by-id/scsi-26364336339636137') {{(pid=86373) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d87616f-11ff-476d-99fd-686a77ec3b44]: (4, None) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba71fd9c-9afc-4872-be74-76f707775879]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c76a813-ae9e-4424-aea6-207a82848ec2]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260]
Nov 14 15:05:10 user nova-compute[75292]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f, portal: 172.16.0.220,3260] successful.
Nov 14 15:05:10 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5663cc05-0363-4b88-9dba-88c0d983b90f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8def1-ccf8-4ce1-b109-4491742c85d0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== disconnect_volume: return (352ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:05:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Deleting instance files /opt/stack/data/nova/instances/dd2fb582-aba1-4162-85cd-8bf001f4b548_del
Nov 14 15:05:10 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Deletion of /opt/stack/data/nova/instances/dd2fb582-aba1-4162-85cd-8bf001f4b548_del complete
Nov 14 15:05:10 user nova-compute[75292]: INFO nova.compute.manager [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 15:05:10 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:05:10 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:05:10 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Took 0.46 seconds to deallocate network for instance.
Nov 14 15:05:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-43e47fc5-f0a8-4d1e-afa1-71d1661a589a req-565e1420-0cc2-47f9-86da-d2ef068235c9 service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-vif-deleted-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-vif-unplugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] No waiting events found dispatching network-vif-unplugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-vif-unplugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received event network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] Acquiring lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.compute.manager [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] No waiting events found dispatching network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:05:11 user nova-compute[75292]: WARNING nova.compute.manager [req-37c0522b-df7c-4d57-b237-75bf409cfbf7 req-966dc155-cc09-4c06-9bec-05f05045abfd service nova] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Received unexpected event network-vif-plugged-68698dd9-6e4a-4cb0-a411-5c87d7cc7c6d for instance with vm_state active and task_state deleting.
Nov 14 15:05:11 user nova-compute[75292]: INFO nova.compute.manager [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: dd2fb582-aba1-4162-85cd-8bf001f4b548] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:05:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:11 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Deleted allocations for instance dd2fb582-aba1-4162-85cd-8bf001f4b548
Nov 14 15:05:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d21bb8b7-125c-44c5-ad34-adc7d21c6df2 tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "dd2fb582-aba1-4162-85cd-8bf001f4b548" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.821s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:22 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:29 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:05:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:05:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:05:29 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:05:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:32 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:05:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:35 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:35 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:05:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:05:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=25.147720336914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 8dbb1152-7cb7-447b-b71e-0202c3cae831 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f3b39492-5aeb-4dc2-b8bc-27b941004926 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:05:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:42 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:05:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:05:42 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:05:42 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'info_cache' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:42 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:05:43 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance destroyed successfully.
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'resources' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d1841cb-e4, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53dcbdb6-a01e-45c9-9260-e39b0a6151da) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:43 user nova-compute[75292]: INFO os_vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4')
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:05:43 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf3ea8a-1965-4536-beec-f561d2c15edc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:05:43 user nova-compute[75292]: No targets found.
Nov 14 15:05:43 user nova-compute[75292]: iSNS:
Nov 14 15:05:43 user nova-compute[75292]: No targets found.
Nov 14 15:05:43 user nova-compute[75292]: STATIC:
Nov 14 15:05:43 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e
Nov 14 15:05:43 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:05:43 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:05:43 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 15:05:43 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:05:43 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:05:43 user nova-compute[75292]: FIRMWARE:
Nov 14 15:05:43 user nova-compute[75292]: No targets found.
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:05:43 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:05:43 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68741160-932c-46d4-8b03-5dbf8ccf09f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7994f75-17cc-49f0-93ff-aa7655108740]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:43 user nova-compute[75292]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:43 user nova-compute[75292]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b5419b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a06b8fc-0097-4556-aeb8-4b62d0699721]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb63c56d-15ca-4eb9-b08c-7f2fd14dec71]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[998f49fc-f665-46fc-8ec2-76b486db7cb5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e140d58a-55a5-496c-84fd-1e77ee26baed]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cf1165-151a-4394-b471-530778248fc1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8c359-a36a-47cb-99e8-c6fe89801fa7]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]
Nov 14 15:05:43 user nova-compute[75292]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[09352de6-8364-478b-a7fe-29074d492a39]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== disconnect_volume: return (281ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start _get_guest_xml network_info=[{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f44e9f87-a2ae-4f5d-9142-b064703739bf', 'boot_index': None, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '76608663-985f-4b5d-8634-1174fd598686', 'attached_at': '', 'detached_at': '', 'volume_id': '4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'serial': '4cc39d74-4533-40cb-9c7a-f571ad8d395e'}, 'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'delete_on_termination': False, 'volume_type': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'numa_topology' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:43 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:05:43 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:05:43 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:05:43 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:05:43 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0a379f-76d0-4d01-b4c0-97467049d41d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:05:43 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc68b42a-0786-4375-a7a2-8bb4ffaeb569]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e] added
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10068530-1907-4a0b-9c39-dd9d86bd8e84]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d1e48e-d843-445b-974f-a61baa7619bb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqGJVTL {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dOqGJVTL" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df58da6-8eaa-4cc0-b0b5-e08069d563e5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dOqGJVTL'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ead3f4-106f-4848-91f2-c39901958064]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd737ec2-fd67-4786-9760-ba8bfddd683e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:43 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:05:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ffbf6a-9478-46cc-816e-7940aaee063d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]
Nov 14 15:05:44 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.
Nov 14 15:05:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aed4b9-06e0-4d66-831e-88595338465d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c46a5c-c46c-4195-a737-5f059aa7a377]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:44 user nova-compute[75292]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:05:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:05:44 user nova-compute[75292]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:05:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[997fa42c-6da0-4ce3-9490-2e5aeac4a9a3]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:05:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26262646338656566', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262646338656566', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'pci_devices' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:05:45 user nova-compute[75292]:   <uuid>76608663-985f-4b5d-8634-1174fd598686</uuid>
Nov 14 15:05:45 user nova-compute[75292]:   <name>instance-00000030</name>
Nov 14 15:05:45 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:05:45 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:05:45 user nova-compute[75292]:   <metadata>
Nov 14 15:05:45 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:05:45 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:05:45 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeTestJSON-server-1460218955</nova:name>
Nov 14 15:05:45 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:05:43</nova:creationTime>
Nov 14 15:05:45 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:05:45 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:05:45 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:05:45 user nova-compute[75292]:       <nova:owner>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:user uuid="3dbc24e3bc2446fb9c633b220a9de990">tempest-AttachVolumeTestJSON-2139193622-project-member</nova:user>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:project uuid="e54ddffd17e449719cf8caaac639adc0">tempest-AttachVolumeTestJSON-2139193622</nova:project>
Nov 14 15:05:45 user nova-compute[75292]:       </nova:owner>
Nov 14 15:05:45 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:05:45 user nova-compute[75292]:       <nova:ports>
Nov 14 15:05:45 user nova-compute[75292]:         <nova:port uuid="1d1841cb-e46c-4f74-b8a6-3880730a8b65">
Nov 14 15:05:45 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 15:05:45 user nova-compute[75292]:         </nova:port>
Nov 14 15:05:45 user nova-compute[75292]:       </nova:ports>
Nov 14 15:05:45 user nova-compute[75292]:     </nova:instance>
Nov 14 15:05:45 user nova-compute[75292]:   </metadata>
Nov 14 15:05:45 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:05:45 user nova-compute[75292]:     <system>
Nov 14 15:05:45 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:05:45 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:05:45 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:05:45 user nova-compute[75292]:       <entry name="serial">76608663-985f-4b5d-8634-1174fd598686</entry>
Nov 14 15:05:45 user nova-compute[75292]:       <entry name="uuid">76608663-985f-4b5d-8634-1174fd598686</entry>
Nov 14 15:05:45 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:05:45 user nova-compute[75292]:     </system>
Nov 14 15:05:45 user nova-compute[75292]:   </sysinfo>
Nov 14 15:05:45 user nova-compute[75292]:   <os>
Nov 14 15:05:45 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:05:45 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:05:45 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:05:45 user nova-compute[75292]:   </os>
Nov 14 15:05:45 user nova-compute[75292]:   <features>
Nov 14 15:05:45 user nova-compute[75292]:     <acpi/>
Nov 14 15:05:45 user nova-compute[75292]:     <apic/>
Nov 14 15:05:45 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:05:45 user nova-compute[75292]:   </features>
Nov 14 15:05:45 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:05:45 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:05:45 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:05:45 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:05:45 user nova-compute[75292]:   </clock>
Nov 14 15:05:45 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:05:45 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:05:45 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:05:45 user nova-compute[75292]:   </cpu>
Nov 14 15:05:45 user nova-compute[75292]:   <devices>
Nov 14 15:05:45 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:05:45 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:05:45 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk"/>
Nov 14 15:05:45 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:05:45 user nova-compute[75292]:     </disk>
Nov 14 15:05:45 user nova-compute[75292]:     <disk type="block" device="disk">
Nov 14 15:05:45 user nova-compute[75292]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:05:45 user nova-compute[75292]:       <source dev="/dev/sdc"/>
Nov 14 15:05:45 user nova-compute[75292]:       <target dev="vdb" bus="virtio"/>
Nov 14 15:05:45 user nova-compute[75292]:       <serial>4cc39d74-4533-40cb-9c7a-f571ad8d395e</serial>
Nov 14 15:05:45 user nova-compute[75292]:     </disk>
Nov 14 15:05:45 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:05:45 user nova-compute[75292]:       <mac address="fa:16:3e:f0:7c:7c"/>
Nov 14 15:05:45 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:05:45 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:05:45 user nova-compute[75292]:       <target dev="tap1d1841cb-e4"/>
Nov 14 15:05:45 user nova-compute[75292]:     </interface>
Nov 14 15:05:45 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:05:45 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/console.log" append="off"/>
Nov 14 15:05:45 user nova-compute[75292]:     </serial>
Nov 14 15:05:45 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:05:45 user nova-compute[75292]:     <video>
Nov 14 15:05:45 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:05:45 user nova-compute[75292]:     </video>
Nov 14 15:05:45 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:05:45 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:05:45 user nova-compute[75292]:     </rng>
Nov 14 15:05:45 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:05:45 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:05:45 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:05:45 user nova-compute[75292]:     </memballoon>
Nov 14 15:05:45 user nova-compute[75292]:   </devices>
Nov 14 15:05:45 user nova-compute[75292]: </domain>
Nov 14 15:05:45 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Cannot resize image /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'migration_context' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.objects.base [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:03:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG os_vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28054bae-3494-571f-b176-89085bd4ff50', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d1841cb-e4, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d1841cb-e4, col_values=(('qos', UUID('45781530-7bb7-40bc-a07f-f520f595a35e')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d1841cb-e4, col_values=(('external_ids', {'iface-id': '1d1841cb-e46c-4f74-b8a6-3880730a8b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:7c:7c', 'vm-uuid': '76608663-985f-4b5d-8634-1174fd598686'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:05:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:45 user nova-compute[75292]: INFO os_vif [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4')
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-4bf4e428-18bf-4ff0-88e0-bd6be3d07080 req-9cca70a4-8bb1-43d8-84ec-e2a9a323f8e5 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4bf4e428-18bf-4ff0-88e0-bd6be3d07080 req-9cca70a4-8bb1-43d8-84ec-e2a9a323f8e5 service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4bf4e428-18bf-4ff0-88e0-bd6be3d07080 req-9cca70a4-8bb1-43d8-84ec-e2a9a323f8e5 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4bf4e428-18bf-4ff0-88e0-bd6be3d07080 req-9cca70a4-8bb1-43d8-84ec-e2a9a323f8e5 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG nova.compute.manager [req-4bf4e428-18bf-4ff0-88e0-bd6be3d07080 req-9cca70a4-8bb1-43d8-84ec-e2a9a323f8e5 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:05:47 user nova-compute[75292]: WARNING nova.compute.manager [req-4bf4e428-18bf-4ff0-88e0-bd6be3d07080 req-9cca70a4-8bb1-43d8-84ec-e2a9a323f8e5 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state powering-on.
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:05:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance rebooted successfully.
Nov 14 15:05:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ad322cfc-12a9-4d88-a380-404d0ec734dc tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:05:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-b99dcee6-6816-4dba-8e85-8b73e8239301 req-805549a7-7a01-4ea6-9462-1efdb23b570d service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:05:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b99dcee6-6816-4dba-8e85-8b73e8239301 req-805549a7-7a01-4ea6-9462-1efdb23b570d service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:05:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b99dcee6-6816-4dba-8e85-8b73e8239301 req-805549a7-7a01-4ea6-9462-1efdb23b570d service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:05:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-b99dcee6-6816-4dba-8e85-8b73e8239301 req-805549a7-7a01-4ea6-9462-1efdb23b570d service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:05:49 user nova-compute[75292]: DEBUG nova.compute.manager [req-b99dcee6-6816-4dba-8e85-8b73e8239301 req-805549a7-7a01-4ea6-9462-1efdb23b570d service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:05:49 user nova-compute[75292]: WARNING nova.compute.manager [req-b99dcee6-6816-4dba-8e85-8b73e8239301 req-805549a7-7a01-4ea6-9462-1efdb23b570d service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state active and task_state None.
Nov 14 15:05:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:05:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-changed-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG nova.compute.manager [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Refreshing instance network info cache due to event network-changed-0eddc264-57d8-4aea-8c80-3c8b55af501f. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] Acquiring lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] Acquired lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG nova.network.neutron [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Refreshing network info cache for port 0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:03 user nova-compute[75292]: INFO nova.compute.manager [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Terminating instance
Nov 14 15:06:03 user nova-compute[75292]: DEBUG nova.compute.manager [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updated VIF entry in instance network info cache for port 0eddc264-57d8-4aea-8c80-3c8b55af501f. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.network.neutron [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating instance_info_cache with network_info: [{"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-092c7a74-e131-4066-829e-be03ca3ff84a req-7e8b0697-cbc8-4e1f-9183-fa4545b6734f service nova] Releasing lock "refresh_cache-8dbb1152-7cb7-447b-b71e-0202c3cae831" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Instance destroyed successfully.
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.objects.instance [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lazy-loading 'resources' on Instance uuid 8dbb1152-7cb7-447b-b71e-0202c3cae831 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1100840305',display_name='tempest-TestVolumeBootPattern-server-1100840305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1100840305',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKzCkponbyghNVZRH2qKoazAVZiMhgVnrD0VT+ZmYPK7DW2QJj5Lvca6R7wm1jvuMG+z/EMD1ZvBn8/4q1uOe9wuTz9Pwz6g4My7ZdmWjjUKPQ/WNwIwqQy0QI6XHRyVQ==',key_name='tempest-TestVolumeBootPattern-13708980',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6cebd367820b4847b1f8b7c402a22ffc',ramdisk_id='',reservation_id='r-ossq0sz2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-53606599',owner_user_name='tempest-TestVolumeBootPattern-53606599-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:01:30Z,user_data=None,user_id='12846e84377c40998d795e5f0b09252f',uuid=8dbb1152-7cb7-447b-b71e-0202c3cae831,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converting VIF {"id": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "address": "fa:16:3e:f4:03:2f", "network": {"id": "96c31a76-7afa-4a90-87db-c4a022cb4da4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-837179503-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6cebd367820b4847b1f8b7c402a22ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0eddc264-57", "ovs_interfaceid": "0eddc264-57d8-4aea-8c80-3c8b55af501f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_vif [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0eddc264-57, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28372c38-34a8-40cf-b029-9a248841c297) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:04 user nova-compute[75292]: INFO os_vif [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:03:2f,bridge_name='br-int',has_traffic_filtering=True,id=0eddc264-57d8-4aea-8c80-3c8b55af501f,network=Network(96c31a76-7afa-4a90-87db-c4a022cb4da4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0eddc264-57')
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kVopBxEW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:06:04 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c8da7-dad2-47ff-af93-0ec57b6986fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:06:04 user nova-compute[75292]: No targets found.
Nov 14 15:06:04 user nova-compute[75292]: iSNS:
Nov 14 15:06:04 user nova-compute[75292]: No targets found.
Nov 14 15:06:04 user nova-compute[75292]: STATIC:
Nov 14 15:06:04 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e
Nov 14 15:06:04 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:06:04 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:06:04 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a
Nov 14 15:06:04 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:06:04 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:06:04 user nova-compute[75292]: FIRMWARE:
Nov 14 15:06:04 user nova-compute[75292]: No targets found.
Nov 14 15:06:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:06:04 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:06:04 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1b4671-fc49-45cf-bc8d-ec377750aea9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a22405-d880-43fc-869b-d8cede846bdf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:06:04 user nova-compute[75292]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:06:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a (non-flash)
Nov 14 15:06:04 user nova-compute[75292]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:06:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b54333130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec2535f-ac26-4b45-9118-e60133351b89]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b578bdd3-0d7e-4b55-a118-6fcd9ba177b5]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec7ea5-fa09-4a31-9d41-dcc157b1506f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d1a6cd-2472-4d85-a923-738625f37ca1]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_159ed9b3', '/dev/disk/by-id/scsi-1SCST_BIO159ed9b3-40fa626f0718ecd2', '/dev/disk/by-id/scsi-23430666136323666') {{(pid=86373) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03537a3-143d-4a1e-b3cd-f2e3289a1f1d]: (4, None) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[155556be-9f4d-4b78-a59d-443afdb84d59]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568becf-d7dd-4a39-9de1-ff1b1b36e755]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260]
Nov 14 15:06:04 user nova-compute[75292]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a, portal: 172.16.0.220,3260] successful.
Nov 14 15:06:04 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15a49aee-3a0a-4690-8e0d-8c5d1ed37a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7314a26-fdbc-41c3-985a-617bfb8eeb0d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] <== disconnect_volume: return (360ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:06:04 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:06:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Deleting instance files /opt/stack/data/nova/instances/8dbb1152-7cb7-447b-b71e-0202c3cae831_del
Nov 14 15:06:04 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Deletion of /opt/stack/data/nova/instances/8dbb1152-7cb7-447b-b71e-0202c3cae831_del complete
Nov 14 15:06:05 user nova-compute[75292]: INFO nova.compute.manager [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:06:05 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Took 0.50 seconds to deallocate network for instance.
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-6e130c86-9cee-4218-9d63-c1c0583f7c45 req-a43b730d-0117-4a4c-a2fb-5575d1a13ed8 service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-deleted-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-unplugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-unplugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-unplugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:05 user nova-compute[75292]: WARNING nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received unexpected event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with vm_state active and task_state deleting.
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:05 user nova-compute[75292]: WARNING nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received unexpected event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with vm_state active and task_state deleting.
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:05 user nova-compute[75292]: WARNING nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received unexpected event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with vm_state active and task_state deleting.
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-unplugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-unplugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-unplugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Acquiring lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:05 user nova-compute[75292]: DEBUG nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] No waiting events found dispatching network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:05 user nova-compute[75292]: WARNING nova.compute.manager [req-92a1726d-6c9a-47fe-8a0a-9fcf61e30be9 req-5313cbec-a0ee-4afd-9474-d4079e55868c service nova] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Received unexpected event network-vif-plugged-0eddc264-57d8-4aea-8c80-3c8b55af501f for instance with vm_state active and task_state deleting.
Nov 14 15:06:06 user nova-compute[75292]: INFO nova.compute.manager [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] [instance: 8dbb1152-7cb7-447b-b71e-0202c3cae831] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 15:06:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:06 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:06:06 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:06:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.159s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:06 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Deleted allocations for instance 8dbb1152-7cb7-447b-b71e-0202c3cae831
Nov 14 15:06:06 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-ddc6e1ee-7d3b-4c2f-a2c0-97cfab40638d tempest-TestVolumeBootPattern-53606599 tempest-TestVolumeBootPattern-53606599-project-member] Lock "8dbb1152-7cb7-447b-b71e-0202c3cae831" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:12 user nova-compute[75292]: INFO nova.compute.manager [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Terminating instance
Nov 14 15:06:12 user nova-compute[75292]: DEBUG nova.compute.manager [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-366cb479-d82a-4a0d-b465-720e180d202d req-c50c5a17-b7a8-42dc-8bce-6b541598e39a service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-unplugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-366cb479-d82a-4a0d-b465-720e180d202d req-c50c5a17-b7a8-42dc-8bce-6b541598e39a service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-366cb479-d82a-4a0d-b465-720e180d202d req-c50c5a17-b7a8-42dc-8bce-6b541598e39a service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-366cb479-d82a-4a0d-b465-720e180d202d req-c50c5a17-b7a8-42dc-8bce-6b541598e39a service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-366cb479-d82a-4a0d-b465-720e180d202d req-c50c5a17-b7a8-42dc-8bce-6b541598e39a service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-unplugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-366cb479-d82a-4a0d-b465-720e180d202d req-c50c5a17-b7a8-42dc-8bce-6b541598e39a service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-unplugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Instance destroyed successfully.
Nov 14 15:06:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lazy-loading 'resources' on Instance uuid f3b39492-5aeb-4dc2-b8bc-27b941004926 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T15:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-499197565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-499197565',id=45,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAos6/ayEFBl8dK2N3yPu7sE42R3QPa2N2I2NH/mhQ9bMVFnf8ubKD7j2COPWKUvArA5joyHsDk0rqVbynbLzI6TSYXCm84JUcVJcZ8mSzo2UyTBaGT2j06wE+fmLe8Sg==',key_name='tempest-keypair-1317824269',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:04:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f7526301dd346a9a6f3367417755a67',ramdisk_id='',reservation_id='r-wc0iuf38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2139265145',owner_user_name='tempest-AttachVolumeShelveTestJSON-2139265145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:04:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4b3312b416c74d92ae45d7edb5c08512',uuid=f3b39492-5aeb-4dc2-b8bc-27b941004926,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converting VIF {"id": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "address": "fa:16:3e:d7:d6:d3", "network": {"id": "ac7db9d7-31fc-436c-b035-ea87e496cd68", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-702679387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f7526301dd346a9a6f3367417755a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap172db38c-ba", "ovs_interfaceid": "172db38c-ba90-4c26-b1c1-a04f904da4d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG os_vif [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap172db38c-ba, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbb9dbc6-0add-4ed5-9107-6dc6b410f413) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:13 user nova-compute[75292]: INFO os_vif [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d6:d3,bridge_name='br-int',has_traffic_filtering=True,id=172db38c-ba90-4c26-b1c1-a04f904da4d1,network=Network(ac7db9d7-31fc-436c-b035-ea87e496cd68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap172db38c-ba')
Nov 14 15:06:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Deleting instance files /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926_del
Nov 14 15:06:13 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Deletion of /opt/stack/data/nova/instances/f3b39492-5aeb-4dc2-b8bc-27b941004926_del complete
Nov 14 15:06:13 user nova-compute[75292]: INFO nova.compute.manager [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 15:06:13 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:06:13 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:06:14 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Took 0.79 seconds to deallocate network for instance.
Nov 14 15:06:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-5f96cfb4-2929-4294-8660-6ff01cf72644 req-dc7c7917-8c5f-4150-b4d8-97d19b1ea682 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-deleted-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:14 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Deleted allocations for instance f3b39492-5aeb-4dc2-b8bc-27b941004926
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-dc399afd-e39d-47a1-800e-002424abf126 tempest-AttachVolumeShelveTestJSON-2139265145 tempest-AttachVolumeShelveTestJSON-2139265145-project-member] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.073s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-3c2c34e6-6f19-4aa6-b49f-1313e9233fd9 req-f1d21fad-acec-4650-a438-81a0b805f691 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3c2c34e6-6f19-4aa6-b49f-1313e9233fd9 req-f1d21fad-acec-4650-a438-81a0b805f691 service nova] Acquiring lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3c2c34e6-6f19-4aa6-b49f-1313e9233fd9 req-f1d21fad-acec-4650-a438-81a0b805f691 service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3c2c34e6-6f19-4aa6-b49f-1313e9233fd9 req-f1d21fad-acec-4650-a438-81a0b805f691 service nova] Lock "f3b39492-5aeb-4dc2-b8bc-27b941004926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-3c2c34e6-6f19-4aa6-b49f-1313e9233fd9 req-f1d21fad-acec-4650-a438-81a0b805f691 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] No waiting events found dispatching network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:06:14 user nova-compute[75292]: WARNING nova.compute.manager [req-3c2c34e6-6f19-4aa6-b49f-1313e9233fd9 req-f1d21fad-acec-4650-a438-81a0b805f691 service nova] [instance: f3b39492-5aeb-4dc2-b8bc-27b941004926] Received unexpected event network-vif-plugged-172db38c-ba90-4c26-b1c1-a04f904da4d1 for instance with vm_state deleted and task_state None.
Nov 14 15:06:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:24 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:26 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:06:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:06:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:06:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:06:30 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:06:31 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:06:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:06:31 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:06:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:06:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:36 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:06:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:06:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:06:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=25.16344451904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:06:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:06:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:06:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:06:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:06:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:06:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:06:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:06:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:07:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:07:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:07:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:07:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:07:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:07:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:07:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:07:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:26 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:26 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:07:30 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:07:31 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:07:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:07:31 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:07:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:07:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:07:33 user nova-compute[75292]: INFO nova.compute.manager [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Detaching volume 4cc39d74-4533-40cb-9c7a-f571ad8d395e
Nov 14 15:07:33 user nova-compute[75292]: INFO nova.virt.block_device [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Attempting to driver detach volume 4cc39d74-4533-40cb-9c7a-f571ad8d395e from mountpoint /dev/vdb
Nov 14 15:07:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Attempting to detach device vdb from instance 76608663-985f-4b5d-8634-1174fd598686 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:07:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:07:33 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:07:33 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:07:33 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:07:33 user nova-compute[75292]:   <serial>4cc39d74-4533-40cb-9c7a-f571ad8d395e</serial>
Nov 14 15:07:33 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 15:07:33 user nova-compute[75292]: </disk>
Nov 14 15:07:33 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:07:34 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully detached device vdb from instance 76608663-985f-4b5d-8634-1174fd598686 from the persistent domain config.
Nov 14 15:07:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76608663-985f-4b5d-8634-1174fd598686 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:07:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:07:34 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:07:34 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:07:34 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:07:34 user nova-compute[75292]:   <serial>4cc39d74-4533-40cb-9c7a-f571ad8d395e</serial>
Nov 14 15:07:34 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 15:07:34 user nova-compute[75292]: </disk>
Nov 14 15:07:34 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:07:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:07:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:07:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:07:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:07:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:07:37 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:07:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:38 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:07:38 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.159839630126953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:07:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:07:39 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:07:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:07:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:07:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 76608663-985f-4b5d-8634-1174fd598686 is timed out.
Nov 14 15:07:54 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully detached device vdb from instance 76608663-985f-4b5d-8634-1174fd598686 from the live domain config.
Nov 14 15:07:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dOqGJVTL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:07:54 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[635bbc6e-5ea8-4a56-bff8-22ad2316fc7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:07:54 user nova-compute[75292]: No targets found.
Nov 14 15:07:54 user nova-compute[75292]: iSNS:
Nov 14 15:07:54 user nova-compute[75292]: No targets found.
Nov 14 15:07:54 user nova-compute[75292]: STATIC:
Nov 14 15:07:54 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e
Nov 14 15:07:54 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:07:54 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:07:54 user nova-compute[75292]: FIRMWARE:
Nov 14 15:07:54 user nova-compute[75292]: No targets found.
Nov 14 15:07:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:07:54 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:07:54 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46dd473-481f-4814-849a-01a062e714fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c7f4f-9e32-4685-b2cd-8606231f49f4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:07:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e (non-flash)
Nov 14 15:07:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b543339a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f58fc74-c2f7-431b-a19e-150a6e736d2d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa097aaf-903f-4494-b791-e922391db036]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a0aab-f676-4280-87a1-60903fe9a9c6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c52ea9-6598-4433-b54d-f191667de4f0]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5b749d-e764-45ba-a25a-5a031bdface6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9497b02d-3594-4039-a6f2-675024c1317a]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260]
Nov 14 15:07:54 user nova-compute[75292]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e, portal: 172.16.0.220,3260] successful.
Nov 14 15:07:54 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cc39d74-4533-40cb-9c7a-f571ad8d395e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df12baa-4316-42ed-b011-2d92043c3ce5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== disconnect_volume: return (283ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:07:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:55 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:07:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c396d3bc-a4ba-47e2-ac45-a90746371554 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.584s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75292) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG nova.objects.instance [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-55dc607c-ba0b-45bb-8665-cbfbd582d028 req-326feed9-7330-4b94-a0a8-02fd7c5ca140 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-55dc607c-ba0b-45bb-8665-cbfbd582d028 req-326feed9-7330-4b94-a0a8-02fd7c5ca140 service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-55dc607c-ba0b-45bb-8665-cbfbd582d028 req-326feed9-7330-4b94-a0a8-02fd7c5ca140 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-55dc607c-ba0b-45bb-8665-cbfbd582d028 req-326feed9-7330-4b94-a0a8-02fd7c5ca140 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:07:56 user nova-compute[75292]: DEBUG nova.compute.manager [req-55dc607c-ba0b-45bb-8665-cbfbd582d028 req-326feed9-7330-4b94-a0a8-02fd7c5ca140 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:07:56 user nova-compute[75292]: WARNING nova.compute.manager [req-55dc607c-ba0b-45bb-8665-cbfbd582d028 req-326feed9-7330-4b94-a0a8-02fd7c5ca140 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state active and task_state powering-off.
Nov 14 15:07:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:57 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance destroyed successfully.
Nov 14 15:07:57 user nova-compute[75292]: DEBUG nova.compute.manager [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:07:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-3e68d103-3607-4832-af1c-88569f3e4b43 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.970s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:07:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:07:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-c869ab37-b867-4b33-8b40-0002684b038e req-bc2bc13d-7ce3-4607-8f11-7b334417e953 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:07:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c869ab37-b867-4b33-8b40-0002684b038e req-bc2bc13d-7ce3-4607-8f11-7b334417e953 service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:07:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c869ab37-b867-4b33-8b40-0002684b038e req-bc2bc13d-7ce3-4607-8f11-7b334417e953 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:07:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-c869ab37-b867-4b33-8b40-0002684b038e req-bc2bc13d-7ce3-4607-8f11-7b334417e953 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:07:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-c869ab37-b867-4b33-8b40-0002684b038e req-bc2bc13d-7ce3-4607-8f11-7b334417e953 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:07:59 user nova-compute[75292]: WARNING nova.compute.manager [req-c869ab37-b867-4b33-8b40-0002684b038e req-bc2bc13d-7ce3-4607-8f11-7b334417e953 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state None.
Nov 14 15:08:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:08:08 user nova-compute[75292]: INFO nova.compute.claims [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Claim successful on node user
Nov 14 15:08:08 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:08 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:08:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.policy [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9b7348de59a4a4a8dbf0df6de55f2fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '342df781c42a47baa9ef6998a230b3fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:08:09 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Creating image(s)
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "/opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "/opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk 1073741824" returned: 0 in 0.052s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Successfully created port: b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Cannot resize image /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Ensure instance console log exists: /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Successfully updated port: b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-changed-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.compute.manager [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Refreshing instance network info cache due to event network-changed-b39dfa63-ba05-4dbf-a309-ca14c52b1daf. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.neutron [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Instance network_info: |[{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.neutron [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Refreshing network info cache for port b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Start _get_guest_xml network_info=[{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:08:10 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:08:10 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:08:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1216732357',display_name='tempest-SnapshotDataIntegrityTests-server-1216732357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1216732357',id=50,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuwGd5sJg62e51ePIf6A4L+Vz+URbgX1gGBB88M4AVnrowtS9WWY55lwH91seHpppu5JvIz9XIhb05fwb+t8ZHUJeaWpGZ0PdqJH+Z9OZLBsueklwyVu6KVBerEQyoqlw==',key_name='tempest-keypair-5303087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='342df781c42a47baa9ef6998a230b3fa',ramdisk_id='',reservation_id='r-i1c2kv2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1774387768',owner_user_name='tempest-SnapshotDataIntegrityTests-1774387768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b7348de59a4a4a8dbf0df6de55f2fe',uuid=f0eba59b-c83e-4378-9c24-438a509c9f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Converting VIF {"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'pci_devices' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:08:10 user nova-compute[75292]:   <uuid>f0eba59b-c83e-4378-9c24-438a509c9f95</uuid>
Nov 14 15:08:10 user nova-compute[75292]:   <name>instance-00000032</name>
Nov 14 15:08:10 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:08:10 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:08:10 user nova-compute[75292]:   <metadata>
Nov 14 15:08:10 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:08:10 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:08:10 user nova-compute[75292]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1216732357</nova:name>
Nov 14 15:08:10 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:08:10</nova:creationTime>
Nov 14 15:08:10 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:08:10 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:08:10 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:08:10 user nova-compute[75292]:       <nova:owner>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:user uuid="c9b7348de59a4a4a8dbf0df6de55f2fe">tempest-SnapshotDataIntegrityTests-1774387768-project-member</nova:user>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:project uuid="342df781c42a47baa9ef6998a230b3fa">tempest-SnapshotDataIntegrityTests-1774387768</nova:project>
Nov 14 15:08:10 user nova-compute[75292]:       </nova:owner>
Nov 14 15:08:10 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:08:10 user nova-compute[75292]:       <nova:ports>
Nov 14 15:08:10 user nova-compute[75292]:         <nova:port uuid="b39dfa63-ba05-4dbf-a309-ca14c52b1daf">
Nov 14 15:08:10 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 15:08:10 user nova-compute[75292]:         </nova:port>
Nov 14 15:08:10 user nova-compute[75292]:       </nova:ports>
Nov 14 15:08:10 user nova-compute[75292]:     </nova:instance>
Nov 14 15:08:10 user nova-compute[75292]:   </metadata>
Nov 14 15:08:10 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:08:10 user nova-compute[75292]:     <system>
Nov 14 15:08:10 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:08:10 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:08:10 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:08:10 user nova-compute[75292]:       <entry name="serial">f0eba59b-c83e-4378-9c24-438a509c9f95</entry>
Nov 14 15:08:10 user nova-compute[75292]:       <entry name="uuid">f0eba59b-c83e-4378-9c24-438a509c9f95</entry>
Nov 14 15:08:10 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:08:10 user nova-compute[75292]:     </system>
Nov 14 15:08:10 user nova-compute[75292]:   </sysinfo>
Nov 14 15:08:10 user nova-compute[75292]:   <os>
Nov 14 15:08:10 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:08:10 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:08:10 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:08:10 user nova-compute[75292]:   </os>
Nov 14 15:08:10 user nova-compute[75292]:   <features>
Nov 14 15:08:10 user nova-compute[75292]:     <acpi/>
Nov 14 15:08:10 user nova-compute[75292]:     <apic/>
Nov 14 15:08:10 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:08:10 user nova-compute[75292]:   </features>
Nov 14 15:08:10 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:08:10 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:08:10 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:08:10 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:08:10 user nova-compute[75292]:   </clock>
Nov 14 15:08:10 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:08:10 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:08:10 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:08:10 user nova-compute[75292]:   </cpu>
Nov 14 15:08:10 user nova-compute[75292]:   <devices>
Nov 14 15:08:10 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:08:10 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:08:10 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk"/>
Nov 14 15:08:10 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:08:10 user nova-compute[75292]:     </disk>
Nov 14 15:08:10 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:08:10 user nova-compute[75292]:       <mac address="fa:16:3e:b0:8d:7b"/>
Nov 14 15:08:10 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:08:10 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:08:10 user nova-compute[75292]:       <target dev="tapb39dfa63-ba"/>
Nov 14 15:08:10 user nova-compute[75292]:     </interface>
Nov 14 15:08:10 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:08:10 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/console.log" append="off"/>
Nov 14 15:08:10 user nova-compute[75292]:     </serial>
Nov 14 15:08:10 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:08:10 user nova-compute[75292]:     <video>
Nov 14 15:08:10 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:08:10 user nova-compute[75292]:     </video>
Nov 14 15:08:10 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:08:10 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:08:10 user nova-compute[75292]:     </rng>
Nov 14 15:08:10 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:08:10 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:08:10 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:08:10 user nova-compute[75292]:     </memballoon>
Nov 14 15:08:10 user nova-compute[75292]:   </devices>
Nov 14 15:08:10 user nova-compute[75292]: </domain>
Nov 14 15:08:10 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:08:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1216732357',display_name='tempest-SnapshotDataIntegrityTests-server-1216732357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1216732357',id=50,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuwGd5sJg62e51ePIf6A4L+Vz+URbgX1gGBB88M4AVnrowtS9WWY55lwH91seHpppu5JvIz9XIhb05fwb+t8ZHUJeaWpGZ0PdqJH+Z9OZLBsueklwyVu6KVBerEQyoqlw==',key_name='tempest-keypair-5303087',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='342df781c42a47baa9ef6998a230b3fa',ramdisk_id='',reservation_id='r-i1c2kv2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1774387768',owner_user_name='tempest-SnapshotDataIntegrityTests-1774387768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b7348de59a4a4a8dbf0df6de55f2fe',uuid=f0eba59b-c83e-4378-9c24-438a509c9f95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Converting VIF {"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG os_vif [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ca93e7f-33d3-5ec3-b90f-c538072b83ff', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb39dfa63-ba, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb39dfa63-ba, col_values=(('qos', UUID('40440d40-9a82-42aa-8712-9f7576187ece')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb39dfa63-ba, col_values=(('external_ids', {'iface-id': 'b39dfa63-ba05-4dbf-a309-ca14c52b1daf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8d:7b', 'vm-uuid': 'f0eba59b-c83e-4378-9c24-438a509c9f95'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:08:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:10 user nova-compute[75292]: INFO os_vif [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba')
Nov 14 15:08:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:08:11 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No VIF found with MAC fa:16:3e:b0:8d:7b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:08:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updated VIF entry in instance network info cache for port b39dfa63-ba05-4dbf-a309-ca14c52b1daf. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:08:11 user nova-compute[75292]: DEBUG nova.network.neutron [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:08:11 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-cec878cf-848b-49d5-b1ff-ee1542a2ffd8 req-39b4420d-c8b3-438f-9f5d-1994a9ff45e0 service nova] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-45be336a-ba4f-4695-ade7-8944314e353c req-1281c1ad-9a47-4dcd-8f35-67d7eab07707 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-45be336a-ba4f-4695-ade7-8944314e353c req-1281c1ad-9a47-4dcd-8f35-67d7eab07707 service nova] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-45be336a-ba4f-4695-ade7-8944314e353c req-1281c1ad-9a47-4dcd-8f35-67d7eab07707 service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-45be336a-ba4f-4695-ade7-8944314e353c req-1281c1ad-9a47-4dcd-8f35-67d7eab07707 service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG nova.compute.manager [req-45be336a-ba4f-4695-ade7-8944314e353c req-1281c1ad-9a47-4dcd-8f35-67d7eab07707 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] No waiting events found dispatching network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:08:12 user nova-compute[75292]: WARNING nova.compute.manager [req-45be336a-ba4f-4695-ade7-8944314e353c req-1281c1ad-9a47-4dcd-8f35-67d7eab07707 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received unexpected event network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf for instance with vm_state building and task_state spawning.
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:08:14 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Instance spawned successfully.
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:08:14 user nova-compute[75292]: INFO nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:08:14 user nova-compute[75292]: INFO nova.compute.manager [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Took 5.86 seconds to build instance.
Nov 14 15:08:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0f003f12-c434-4b72-86d3-e056c11540f9 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.957s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-935720f3-14ee-413b-98f3-391a6cd3884e req-3071ae9d-c506-42e3-af9c-ffacac796097 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-935720f3-14ee-413b-98f3-391a6cd3884e req-3071ae9d-c506-42e3-af9c-ffacac796097 service nova] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-935720f3-14ee-413b-98f3-391a6cd3884e req-3071ae9d-c506-42e3-af9c-ffacac796097 service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-935720f3-14ee-413b-98f3-391a6cd3884e req-3071ae9d-c506-42e3-af9c-ffacac796097 service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:14 user nova-compute[75292]: DEBUG nova.compute.manager [req-935720f3-14ee-413b-98f3-391a6cd3884e req-3071ae9d-c506-42e3-af9c-ffacac796097 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] No waiting events found dispatching network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:08:14 user nova-compute[75292]: WARNING nova.compute.manager [req-935720f3-14ee-413b-98f3-391a6cd3884e req-3071ae9d-c506-42e3-af9c-ffacac796097 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received unexpected event network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf for instance with vm_state active and task_state None.
Nov 14 15:08:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:27 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:08:30 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:08:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:08:31 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:08:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:08:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:40 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:08:40 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.121063232421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:48 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:08:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Verify base images {{(pid=75292) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Image id bf213fca-dee8-42b3-bde7-bb229ab5915b yields fingerprint fb878b94ece503b57f28f42056b4088113d4123b {{(pid=75292) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 15:08:58 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] image bf213fca-dee8-42b3-bde7-bb229ab5915b at (/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b): checking
Nov 14 15:08:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] image bf213fca-dee8-42b3-bde7-bb229ab5915b at (/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b): image is in use {{(pid=75292) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75292) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] f0eba59b-c83e-4378-9c24-438a509c9f95 is a valid instance name {{(pid=75292) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] f0eba59b-c83e-4378-9c24-438a509c9f95 has a disk file {{(pid=75292) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 15:08:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 is backed by fb878b94ece503b57f28f42056b4088113d4123b {{(pid=75292) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] 76608663-985f-4b5d-8634-1174fd598686 is a valid instance name {{(pid=75292) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] 76608663-985f-4b5d-8634-1174fd598686 has a disk file {{(pid=75292) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 is backed by fb878b94ece503b57f28f42056b4088113d4123b {{(pid=75292) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5
Nov 14 15:08:59 user nova-compute[75292]: WARNING nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Unknown base file: /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Active base files: /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Removable base files: /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480 /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342 /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9 /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5 /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/89f87aebec2dfb5ad40ce739dc20902e5656a61e
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8918aacdcb5dfdce0ba102a90e863bb98aace480
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/008b070e516e1a084ec2129b98c69d46b7a7d342
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a9593e658786bdc81fb00df0dd976f0eec95f30c
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8e710a7351941b0d49ebb099f1f141b0f1b75ffd
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea03d8a03630b02fc58f9dcfea1316de20cf0bc9
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/509f52b4a261c6ef7a3812d6697d86a11e1303ac
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c81e7ebc56003aa3e709a330a893dd39bce6afe5
Nov 14 15:08:59 user nova-compute[75292]: INFO nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/81696bfe1328617d9b8aa173d5103a6219de5537
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Verification complete {{(pid=75292) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Verify swap images {{(pid=75292) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 15:08:59 user nova-compute[75292]: DEBUG nova.virt.libvirt.imagecache [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Verify ephemeral images {{(pid=75292) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 15:09:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:09:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:09:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:09:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:28 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:09:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:09:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:09:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:32 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:09:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:09:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:09:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:09:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:09:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:09:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:09:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 15:09:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:09:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:39 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:40 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:09:40 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8944MB free_disk=25.12029266357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:09:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Triggering sync for uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:09:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:09:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:09:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:09:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:09:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'info_cache' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:47 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance destroyed successfully.
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'resources' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG os_vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d1841cb-e4, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45781530-7bb7-40bc-a07f-f520f595a35e) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:47 user nova-compute[75292]: INFO os_vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4')
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start _get_guest_xml network_info=[{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'numa_topology' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:47 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:09:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'pci_devices' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:09:48 user nova-compute[75292]:   <uuid>76608663-985f-4b5d-8634-1174fd598686</uuid>
Nov 14 15:09:48 user nova-compute[75292]:   <name>instance-00000030</name>
Nov 14 15:09:48 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:09:48 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:09:48 user nova-compute[75292]:   <metadata>
Nov 14 15:09:48 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:09:48 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:09:48 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeTestJSON-server-1460218955</nova:name>
Nov 14 15:09:48 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:09:47</nova:creationTime>
Nov 14 15:09:48 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:09:48 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:09:48 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:09:48 user nova-compute[75292]:       <nova:owner>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:user uuid="3dbc24e3bc2446fb9c633b220a9de990">tempest-AttachVolumeTestJSON-2139193622-project-member</nova:user>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:project uuid="e54ddffd17e449719cf8caaac639adc0">tempest-AttachVolumeTestJSON-2139193622</nova:project>
Nov 14 15:09:48 user nova-compute[75292]:       </nova:owner>
Nov 14 15:09:48 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:09:48 user nova-compute[75292]:       <nova:ports>
Nov 14 15:09:48 user nova-compute[75292]:         <nova:port uuid="1d1841cb-e46c-4f74-b8a6-3880730a8b65">
Nov 14 15:09:48 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 15:09:48 user nova-compute[75292]:         </nova:port>
Nov 14 15:09:48 user nova-compute[75292]:       </nova:ports>
Nov 14 15:09:48 user nova-compute[75292]:     </nova:instance>
Nov 14 15:09:48 user nova-compute[75292]:   </metadata>
Nov 14 15:09:48 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:09:48 user nova-compute[75292]:     <system>
Nov 14 15:09:48 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:09:48 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:09:48 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:09:48 user nova-compute[75292]:       <entry name="serial">76608663-985f-4b5d-8634-1174fd598686</entry>
Nov 14 15:09:48 user nova-compute[75292]:       <entry name="uuid">76608663-985f-4b5d-8634-1174fd598686</entry>
Nov 14 15:09:48 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:09:48 user nova-compute[75292]:     </system>
Nov 14 15:09:48 user nova-compute[75292]:   </sysinfo>
Nov 14 15:09:48 user nova-compute[75292]:   <os>
Nov 14 15:09:48 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:09:48 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:09:48 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:09:48 user nova-compute[75292]:   </os>
Nov 14 15:09:48 user nova-compute[75292]:   <features>
Nov 14 15:09:48 user nova-compute[75292]:     <acpi/>
Nov 14 15:09:48 user nova-compute[75292]:     <apic/>
Nov 14 15:09:48 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:09:48 user nova-compute[75292]:   </features>
Nov 14 15:09:48 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:09:48 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:09:48 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:09:48 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:09:48 user nova-compute[75292]:   </clock>
Nov 14 15:09:48 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:09:48 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:09:48 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:09:48 user nova-compute[75292]:   </cpu>
Nov 14 15:09:48 user nova-compute[75292]:   <devices>
Nov 14 15:09:48 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:09:48 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:09:48 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk"/>
Nov 14 15:09:48 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:09:48 user nova-compute[75292]:     </disk>
Nov 14 15:09:48 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:09:48 user nova-compute[75292]:       <mac address="fa:16:3e:f0:7c:7c"/>
Nov 14 15:09:48 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:09:48 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:09:48 user nova-compute[75292]:       <target dev="tap1d1841cb-e4"/>
Nov 14 15:09:48 user nova-compute[75292]:     </interface>
Nov 14 15:09:48 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:09:48 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/console.log" append="off"/>
Nov 14 15:09:48 user nova-compute[75292]:     </serial>
Nov 14 15:09:48 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:09:48 user nova-compute[75292]:     <video>
Nov 14 15:09:48 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:09:48 user nova-compute[75292]:     </video>
Nov 14 15:09:48 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:09:48 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:09:48 user nova-compute[75292]:     </rng>
Nov 14 15:09:48 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:09:48 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:09:48 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:09:48 user nova-compute[75292]:     </memballoon>
Nov 14 15:09:48 user nova-compute[75292]:   </devices>
Nov 14 15:09:48 user nova-compute[75292]: </domain>
Nov 14 15:09:48 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Cannot resize image /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.instance [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'migration_context' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.objects.base [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Object Instance<76608663-985f-4b5d-8634-1174fd598686> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75292) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG os_vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28054bae-3494-571f-b176-89085bd4ff50', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d1841cb-e4, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d1841cb-e4, col_values=(('qos', UUID('9b75087c-e77b-474b-8b54-eb7ef350a66f')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d1841cb-e4, col_values=(('external_ids', {'iface-id': '1d1841cb-e46c-4f74-b8a6-3880730a8b65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:7c:7c', 'vm-uuid': '76608663-985f-4b5d-8634-1174fd598686'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:09:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:48 user nova-compute[75292]: INFO os_vif [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4')
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-58d3da2e-b43f-4027-8be9-615eab4b7fca req-2eb216cb-93fd-4c73-bc48-613d12dfacb4 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58d3da2e-b43f-4027-8be9-615eab4b7fca req-2eb216cb-93fd-4c73-bc48-613d12dfacb4 service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58d3da2e-b43f-4027-8be9-615eab4b7fca req-2eb216cb-93fd-4c73-bc48-613d12dfacb4 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58d3da2e-b43f-4027-8be9-615eab4b7fca req-2eb216cb-93fd-4c73-bc48-613d12dfacb4 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG nova.compute.manager [req-58d3da2e-b43f-4027-8be9-615eab4b7fca req-2eb216cb-93fd-4c73-bc48-613d12dfacb4 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:09:50 user nova-compute[75292]: WARNING nova.compute.manager [req-58d3da2e-b43f-4027-8be9-615eab4b7fca req-2eb216cb-93fd-4c73-bc48-613d12dfacb4 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state stopped and task_state powering-on.
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:09:52 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance rebooted successfully.
Nov 14 15:09:52 user nova-compute[75292]: DEBUG nova.compute.manager [None req-37c0ac4e-14a0-4a0d-a027-7941fef4d6d5 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:09:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-4be2bd56-171b-4cc1-8c19-a6f8f46b88c3 req-c8f28bae-8ea6-4efb-9a89-5b67f6cb4f81 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:09:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4be2bd56-171b-4cc1-8c19-a6f8f46b88c3 req-c8f28bae-8ea6-4efb-9a89-5b67f6cb4f81 service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:09:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4be2bd56-171b-4cc1-8c19-a6f8f46b88c3 req-c8f28bae-8ea6-4efb-9a89-5b67f6cb4f81 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:09:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4be2bd56-171b-4cc1-8c19-a6f8f46b88c3 req-c8f28bae-8ea6-4efb-9a89-5b67f6cb4f81 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:09:52 user nova-compute[75292]: DEBUG nova.compute.manager [req-4be2bd56-171b-4cc1-8c19-a6f8f46b88c3 req-c8f28bae-8ea6-4efb-9a89-5b67f6cb4f81 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:09:52 user nova-compute[75292]: WARNING nova.compute.manager [req-4be2bd56-171b-4cc1-8c19-a6f8f46b88c3 req-c8f28bae-8ea6-4efb-9a89-5b67f6cb4f81 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state active and task_state None.
Nov 14 15:09:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:56 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:09:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 15:09:56 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 15:09:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:09:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-changed-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:09:59 user nova-compute[75292]: DEBUG nova.compute.manager [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Refreshing instance network info cache due to event network-changed-b39dfa63-ba05-4dbf-a309-ca14c52b1daf. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:09:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:09:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:09:59 user nova-compute[75292]: DEBUG nova.network.neutron [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Refreshing network info cache for port b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:10:00 user nova-compute[75292]: DEBUG nova.network.neutron [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updated VIF entry in instance network info cache for port b39dfa63-ba05-4dbf-a309-ca14c52b1daf. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:10:00 user nova-compute[75292]: DEBUG nova.network.neutron [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:10:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-aee2e925-5ef9-4e9a-931b-c9b529a75f9e req-ce057a80-f8cb-4857-8df7-40393047bd05 service nova] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:10:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:10:02 user nova-compute[75292]: INFO nova.compute.manager [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attaching volume 3cc9be22-ef15-4d61-af4b-66eb3e8bb747 to /dev/vdb
Nov 14 15:10:02 user nova-compute[75292]: DEBUG os_brick.utils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba12aa0-bb10-4dda-8982-7c18f0cce7a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[40af0ece-c518-44af-ae28-1142f0e0aeb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c041c92-7af7-4166-aa96-78a5b4ed29de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b82c4a-c732-4871-993f-d59febe8824b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:10:02 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:10:02 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8714627c-8276-451b-8613-95e1cd1b4cda]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG os_brick.utils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:10:02 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating existing volume attachment record: afcbab99-02a6-429f-82a4-07fc4b30c144 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:10:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFXafAoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:10:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:10:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:10:06 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef945ab-be78-4d93-b271-c2eaa56acd98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:10:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f8e7f3-cf6d-46e3-912e-4f4fd28d59fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747] added
Nov 14 15:10:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[13026b6f-2493-4a6a-9df2-0813cfe9a386]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc7eb42-4abe-4f60-87b9-cbe289f4159e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFXafAoP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFXafAoP" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[087b16e2-489d-4a70-9574-25e11724c0f4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFXafAoP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cadf319-b3dc-4d6a-9cc1-d39883c9aa79]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[607832d3-e479-4619-ad54-445a96a40a79]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:10:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:10:06 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:10:06 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:10:06 user nova-compute[75292]: 
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d4da9-4a88-498d-b939-1ed354a2c806]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260]
Nov 14 15:10:06 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260] successful.
Nov 14 15:10:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[47867bc1-43c0-4b86-a732-cb4609c5f6eb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0f5253-63ca-4b5f-8e04-9f754e9127ae]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 (non-flash)
Nov 14 15:10:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 (non-flash)
Nov 14 15:10:06 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814763c-1984-44e8-a826-1c0e8739e1d2]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:10:06 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFXafAoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:10:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:10:07 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23033343631383435', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:10:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033343631383435', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:10:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:10:07 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:10:07 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:10:07 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:10:07 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:10:07 user nova-compute[75292]:   <serial>3cc9be22-ef15-4d61-af4b-66eb3e8bb747</serial>
Nov 14 15:10:07 user nova-compute[75292]: </disk>
Nov 14 15:10:07 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:10:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:10:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:10:08 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No VIF found with MAC fa:16:3e:b0:8d:7b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:10:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c7a1ceab-04e9-4d59-a111-3a4cbf6682f2 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.108s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:10:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:10:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:10:15 user nova-compute[75292]: INFO nova.compute.manager [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Detaching volume 3cc9be22-ef15-4d61-af4b-66eb3e8bb747
Nov 14 15:10:15 user nova-compute[75292]: INFO nova.virt.block_device [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attempting to driver detach volume 3cc9be22-ef15-4d61-af4b-66eb3e8bb747 from mountpoint /dev/vdb
Nov 14 15:10:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Attempting to detach device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:10:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:10:15 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:10:15 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:10:15 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:10:15 user nova-compute[75292]:   <serial>3cc9be22-ef15-4d61-af4b-66eb3e8bb747</serial>
Nov 14 15:10:15 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:10:15 user nova-compute[75292]: </disk>
Nov 14 15:10:15 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:10:15 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config.
Nov 14 15:10:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:10:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:10:15 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:10:15 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:10:15 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:10:15 user nova-compute[75292]:   <serial>3cc9be22-ef15-4d61-af4b-66eb3e8bb747</serial>
Nov 14 15:10:15 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:10:15 user nova-compute[75292]: </disk>
Nov 14 15:10:15 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:10:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:10:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:10:32 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:10:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [{"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:10:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-76608663-985f-4b5d-8634-1174fd598686" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:10:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:10:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 is timed out.
Nov 14 15:10:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config.
Nov 14 15:10:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFXafAoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:10:36 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e70d73c-a47c-4283-8ac7-f1670f9618f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:10:36 user nova-compute[75292]: No targets found.
Nov 14 15:10:36 user nova-compute[75292]: iSNS:
Nov 14 15:10:36 user nova-compute[75292]: No targets found.
Nov 14 15:10:36 user nova-compute[75292]: STATIC:
Nov 14 15:10:36 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747
Nov 14 15:10:36 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:10:36 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:10:36 user nova-compute[75292]: FIRMWARE:
Nov 14 15:10:36 user nova-compute[75292]: No targets found.
Nov 14 15:10:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:10:36 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:10:36 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a369b0b1-9851-40da-ac1c-59bade30c065]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82e5929-1c74-477d-8088-d9d576d17a12]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 (non-flash)
Nov 14 15:10:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 (non-flash)
Nov 14 15:10:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b541064d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e5b363-01a5-4e4b-8737-cf4b311661ab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed72d4c-52d0-41f8-b2c1-be9ff1513bcf]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf716f-6fbf-4787-9b03-66859b70e8e8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a890894-3976-4c72-93fd-8a930d6a96a6]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe56c5a-9fc1-4818-9c7c-2ce66e527e87]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46dc3de-5e0a-4a8a-a515-addb111741b3]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260]
Nov 14 15:10:36 user nova-compute[75292]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747, portal: 172.16.0.220,3260] successful.
Nov 14 15:10:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc9be22-ef15-4d61-af4b-66eb3e8bb747 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4379d-1fe9-449b-a6ea-8c1ca4c13251]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== disconnect_volume: return (303ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:10:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:10:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:10:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-264a686f-5ab4-4d61-9cbe-210922acf28d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:10:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:10:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:10:40 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:10:41 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:10:42 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:10:42 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=25.118118286132812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 76608663-985f-4b5d-8634-1174fd598686 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:10:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:10:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:10:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:10:51 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:10:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:10:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:07 user nova-compute[75292]: DEBUG nova.objects.instance [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:11:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:07 user nova-compute[75292]: INFO nova.compute.manager [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attaching volume 62fc758e-cf08-47fa-98d5-e03bf6300b7f to /dev/vdb
Nov 14 15:11:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0163e301-476a-4aef-a907-2c0abd0d5daa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[78090952-d8e7-4fd4-ae35-fdc7396bee9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6ef24-ed99-46ab-abe7-48562703cff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb0e799-4ea8-4f54-b311-b734aa7e7239]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:11:08 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:11:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[609b067d-5033-42f6-9460-440d4794ac4b]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating existing volume attachment record: 680ec9f5-baad-487c-90d9-d9800dae0017 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:11:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:11:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPIRpkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:11:12 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:11:12 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:11:12 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424ae71-2a9c-49b5-9939-b8a5574de6e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:11:12 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b0e001-90e5-430f-9b49-169c97fd87aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f] added
Nov 14 15:11:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab9d53a-a7bd-4bde-b421-9df870e3a8d3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb7b50b-bd63-4aba-bf0f-f3289f796fe4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMPIRpkz {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lMPIRpkz" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[105ad9c4-f923-4641-9127-2c4cb47298ed]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lMPIRpkz'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2eebe8-3c6b-443d-a098-fd1684111a40]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f496a301-29f3-4763-8c93-d3ba5727079a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:11:12 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:11:12 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:11:12 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:11:12 user nova-compute[75292]: 
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a613b7b-feca-4c28-bcc2-f2126503276e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260]
Nov 14 15:11:12 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260] successful.
Nov 14 15:11:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed26da0-29c8-4a76-b5e6-9b612b16c636]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1865c1e8-155c-4625-9990-522e3c26b937]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f (non-flash)
Nov 14 15:11:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f (non-flash)
Nov 14 15:11:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cada7e1e-ef01-4971-853d-c11d133b919f]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:12 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPIRpkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26334616663363235', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334616663363235', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG nova.objects.instance [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:11:13 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:11:13 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:11:13 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:11:13 user nova-compute[75292]:   <serial>62fc758e-cf08-47fa-98d5-e03bf6300b7f</serial>
Nov 14 15:11:13 user nova-compute[75292]: </disk>
Nov 14 15:11:13 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:11:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No VIF found with MAC fa:16:3e:b0:8d:7b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:11:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-969ab0d5-9f65-457f-a35b-f1b0221faadf tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.078s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:16 user nova-compute[75292]: INFO nova.compute.manager [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Detaching volume 62fc758e-cf08-47fa-98d5-e03bf6300b7f
Nov 14 15:11:16 user nova-compute[75292]: INFO nova.virt.block_device [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attempting to driver detach volume 62fc758e-cf08-47fa-98d5-e03bf6300b7f from mountpoint /dev/vdb
Nov 14 15:11:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Attempting to detach device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:11:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:11:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:11:16 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:11:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:11:16 user nova-compute[75292]:   <serial>62fc758e-cf08-47fa-98d5-e03bf6300b7f</serial>
Nov 14 15:11:16 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:11:16 user nova-compute[75292]: </disk>
Nov 14 15:11:16 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:11:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config.
Nov 14 15:11:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:11:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:11:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:11:16 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:11:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:11:16 user nova-compute[75292]:   <serial>62fc758e-cf08-47fa-98d5-e03bf6300b7f</serial>
Nov 14 15:11:16 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:11:16 user nova-compute[75292]: </disk>
Nov 14 15:11:16 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:11:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:11:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:29 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:30 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:33 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:11:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:11:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:11:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:11:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:11:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:11:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:11:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:11:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:36 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 is timed out.
Nov 14 15:11:36 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config.
Nov 14 15:11:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lMPIRpkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:11:36 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd24273-097b-48b3-b7b3-cb7f9ae359eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:11:36 user nova-compute[75292]: No targets found.
Nov 14 15:11:36 user nova-compute[75292]: iSNS:
Nov 14 15:11:36 user nova-compute[75292]: No targets found.
Nov 14 15:11:36 user nova-compute[75292]: STATIC:
Nov 14 15:11:36 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f
Nov 14 15:11:36 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:11:36 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:11:36 user nova-compute[75292]: FIRMWARE:
Nov 14 15:11:36 user nova-compute[75292]: No targets found.
Nov 14 15:11:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:11:36 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:11:36 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a7949-9e0d-466d-82b4-5329e3e8b948]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b190f17-7c5a-4734-9065-9068aed49a85]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f (non-flash)
Nov 14 15:11:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f (non-flash)
Nov 14 15:11:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b30709870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab29ab-a5f5-4d3c-87c1-04b1cea44f35]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cdd197-2f0d-4f74-a934-d39a9e3beee9]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07134c7-60fd-4271-ac8c-0df1e883701f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50dfe48-4541-474d-9c07-ae8e8afa6fe3]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38ee033-07f8-4b1d-8020-51e6621e3ec4]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f687e8-036d-41c1-9525-55448d02ae8d]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260]
Nov 14 15:11:36 user nova-compute[75292]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f, portal: 172.16.0.220,3260] successful.
Nov 14 15:11:36 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62fc758e-cf08-47fa-98d5-e03bf6300b7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de611ab-a4b3-42ec-af50-4b220f273b4e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== disconnect_volume: return (274ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:11:36 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:11:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:11:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-99053b82-c8d2-45dc-a8de-a374a71c6f5f tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.552s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:38 user nova-compute[75292]: INFO nova.compute.manager [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Terminating instance
Nov 14 15:11:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:11:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-49fae6ec-338d-4c9a-968a-7ff2f2e64296 req-b3e03a43-df4e-4c1d-a917-e2ecd5b17d31 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49fae6ec-338d-4c9a-968a-7ff2f2e64296 req-b3e03a43-df4e-4c1d-a917-e2ecd5b17d31 service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49fae6ec-338d-4c9a-968a-7ff2f2e64296 req-b3e03a43-df4e-4c1d-a917-e2ecd5b17d31 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-49fae6ec-338d-4c9a-968a-7ff2f2e64296 req-b3e03a43-df4e-4c1d-a917-e2ecd5b17d31 service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-49fae6ec-338d-4c9a-968a-7ff2f2e64296 req-b3e03a43-df4e-4c1d-a917-e2ecd5b17d31 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-49fae6ec-338d-4c9a-968a-7ff2f2e64296 req-b3e03a43-df4e-4c1d-a917-e2ecd5b17d31 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Instance destroyed successfully.
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.objects.instance [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'resources' on Instance uuid 76608663-985f-4b5d-8634-1174fd598686 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1460218955',display_name='tempest-AttachVolumeTestJSON-server-1460218955',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1460218955',id=48,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJnaYO+ddT2LdevpuV9v/2KCg1ekfRok4xo3usc/dqD/8WYRJ0sLYc33NPtOX0IM5IhjpiIQCH+vIGylbDe+anSDf5uwNG4VD8q1cUH4wR1GocjjpSQQuDZ0Ct7png5ilQ==',key_name='tempest-keypair-632064746',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:01:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-rej3906o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:09:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=76608663-985f-4b5d-8634-1174fd598686,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "address": "fa:16:3e:f0:7c:7c", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d1841cb-e4", "ovs_interfaceid": "1d1841cb-e46c-4f74-b8a6-3880730a8b65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG os_vif [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d1841cb-e4, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b75087c-e77b-474b-8b54-eb7ef350a66f) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: INFO os_vif [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:7c:7c,bridge_name='br-int',has_traffic_filtering=True,id=1d1841cb-e46c-4f74-b8a6-3880730a8b65,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d1841cb-e4')
Nov 14 15:11:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Deleting instance files /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686_del
Nov 14 15:11:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Deletion of /opt/stack/data/nova/instances/76608663-985f-4b5d-8634-1174fd598686_del complete
Nov 14 15:11:39 user nova-compute[75292]: INFO nova.compute.manager [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 76608663-985f-4b5d-8634-1174fd598686] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 15:11:39 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:11:40 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 76608663-985f-4b5d-8634-1174fd598686] Took 0.88 seconds to deallocate network for instance.
Nov 14 15:11:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG nova.compute.manager [req-5a164b69-0afb-4a5e-a32e-e2b78395f77e req-47e6ecb6-f2ff-456c-b883-1f28dfcb4448 service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-deleted-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:40 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Deleted allocations for instance 76608663-985f-4b5d-8634-1174fd598686
Nov 14 15:11:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-21cf0523-2ea2-4e16-96e0-d3b548a77950 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "76608663-985f-4b5d-8634-1174fd598686" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:11:41 user nova-compute[75292]: WARNING nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state deleted and task_state None.
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:11:41 user nova-compute[75292]: WARNING nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state deleted and task_state None.
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:11:41 user nova-compute[75292]: WARNING nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state deleted and task_state None.
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:11:41 user nova-compute[75292]: WARNING nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-unplugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state deleted and task_state None.
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Acquiring lock "76608663-985f-4b5d-8634-1174fd598686-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] Lock "76608663-985f-4b5d-8634-1174fd598686-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] No waiting events found dispatching network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:11:41 user nova-compute[75292]: WARNING nova.compute.manager [req-9258ef2a-5a3d-49e7-ae9a-75d9363dea0a req-7b1d38dc-86ca-4b62-9e9c-9ff10e5ec97a service nova] [instance: 76608663-985f-4b5d-8634-1174fd598686] Received unexpected event network-vif-plugged-1d1841cb-e46c-4f74-b8a6-3880730a8b65 for instance with vm_state deleted and task_state None.
Nov 14 15:11:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:42 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:11:42 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:11:43 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:11:43 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.145084381103516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:11:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:11:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:11:52 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:11:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:11:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:11:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:11:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:11:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:11:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:11:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:11:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:11:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:11:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:08 user nova-compute[75292]: INFO nova.compute.manager [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attaching volume a8e08687-1d60-4f82-bada-784f84c1804d to /dev/vdb
Nov 14 15:12:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f92b0-cb09-4cd9-9b49-52557b4d0ffa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[473fea7f-4482-4ae7-b867-42cbfcb4a6ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c417810a-cb50-411b-8568-952f98fb6822]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e43a2c-24e8-4553-9ef1-332b1c1a9fe2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:12:08 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:12:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[590936b1-1f87-4c8a-90f1-dcd92f8afeeb]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:12:08 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating existing volume attachment record: 8b7d091a-fec6-412a-95ba-a2983dd7fb2a {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:12:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:12:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMXHTbnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:12:12 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:12:12 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:12:12 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68127199-9c33-496e-aba7-fa40dc9ba1e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:12:12 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[638fd49a-82bb-4e71-bc39-8704e9822da8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d] added
Nov 14 15:12:12 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38fcde5-b263-4055-b397-ca2e4f468146]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f391c4-559e-4ec4-8e43-cd7ef7a19380]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMXHTbnq {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMXHTbnq" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe19d7-0feb-46b2-8587-3c15680fb5eb]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AMXHTbnq'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:12 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[43869454-fdaf-44e4-8194-1dde190eed35]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165423b-a8c9-4213-b1db-74dcebb3fc83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:12:13 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:12:13 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:12:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:12:13 user nova-compute[75292]: 
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[71860d59-23a4-4844-903b-18407a2843bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260]
Nov 14 15:12:13 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260] successful.
Nov 14 15:12:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3113e197-ad0d-46af-aebe-19b24d24ea2e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[78037b34-6dea-4317-8175-c81bcea3208d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d (non-flash)
Nov 14 15:12:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d (non-flash)
Nov 14 15:12:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d05a8-6cf8-49d4-b5ec-2d743072df9b]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:12:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMXHTbnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26238363033383266', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238363033383266', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:12:14 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:12:14 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:12:14 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:12:14 user nova-compute[75292]:   <serial>a8e08687-1d60-4f82-bada-784f84c1804d</serial>
Nov 14 15:12:14 user nova-compute[75292]: </disk>
Nov 14 15:12:14 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No VIF found with MAC fa:16:3e:b0:8d:7b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d4b341bf-ab7d-4055-b99a-a0a7ed655107 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.331s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:16 user nova-compute[75292]: INFO nova.compute.manager [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Detaching volume a8e08687-1d60-4f82-bada-784f84c1804d
Nov 14 15:12:16 user nova-compute[75292]: INFO nova.virt.block_device [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attempting to driver detach volume a8e08687-1d60-4f82-bada-784f84c1804d from mountpoint /dev/vdb
Nov 14 15:12:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Attempting to detach device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:12:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:12:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:12:16 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:12:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:12:16 user nova-compute[75292]:   <serial>a8e08687-1d60-4f82-bada-784f84c1804d</serial>
Nov 14 15:12:16 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:12:16 user nova-compute[75292]: </disk>
Nov 14 15:12:16 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:12:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config.
Nov 14 15:12:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:12:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:12:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:12:16 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:12:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:12:16 user nova-compute[75292]:   <serial>a8e08687-1d60-4f82-bada-784f84c1804d</serial>
Nov 14 15:12:16 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:12:16 user nova-compute[75292]: </disk>
Nov 14 15:12:16 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:12:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:12:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:12:32 user nova-compute[75292]: INFO nova.compute.claims [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Claim successful on node user
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.network.neutron [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:12:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.policy [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3dbc24e3bc2446fb9c633b220a9de990', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54ddffd17e449719cf8caaac639adc0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:12:32 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Creating image(s)
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "/opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "/opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "/opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.184s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:32 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk 1073741824" returned: 0 in 0.051s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Successfully created port: 130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Cannot resize image /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Ensure instance console log exists: /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Successfully updated port: 130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquired lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.network.neutron [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-changed-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG nova.compute.manager [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Refreshing instance network info cache due to event network-changed-130fb9b0-8db7-45c8-b317-da3b33d39f46. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:12:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] Acquiring lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.neutron [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating instance_info_cache with network_info: [{"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Releasing lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Instance network_info: |[{"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] Acquired lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Refreshing network info cache for port 130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Start _get_guest_xml network_info=[{"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:12:34 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:12:34 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980037636',display_name='tempest-AttachVolumeTestJSON-server-980037636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980037636',id=51,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC23jGnBVf9EtzVj78xBfkC36/mgdQBvOHXE4QK/AIdQA5JVY9iaZN61ao2+XwrfjkMe7nxQrPPDLtL13drUtdfnLBngJCz7CV9OOhRpzPKukjFJ60lC2m35JJh/3R3zRA==',key_name='tempest-keypair-1620010421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-dceg7e0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=3905c292-28c0-4146-9a3c-b54d18b9074c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.objects.instance [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'pci_devices' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:12:34 user nova-compute[75292]:   <uuid>3905c292-28c0-4146-9a3c-b54d18b9074c</uuid>
Nov 14 15:12:34 user nova-compute[75292]:   <name>instance-00000033</name>
Nov 14 15:12:34 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:12:34 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:12:34 user nova-compute[75292]:   <metadata>
Nov 14 15:12:34 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:12:34 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:12:34 user nova-compute[75292]:       <nova:name>tempest-AttachVolumeTestJSON-server-980037636</nova:name>
Nov 14 15:12:34 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:12:34</nova:creationTime>
Nov 14 15:12:34 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:12:34 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:12:34 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:12:34 user nova-compute[75292]:       <nova:owner>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:user uuid="3dbc24e3bc2446fb9c633b220a9de990">tempest-AttachVolumeTestJSON-2139193622-project-member</nova:user>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:project uuid="e54ddffd17e449719cf8caaac639adc0">tempest-AttachVolumeTestJSON-2139193622</nova:project>
Nov 14 15:12:34 user nova-compute[75292]:       </nova:owner>
Nov 14 15:12:34 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:12:34 user nova-compute[75292]:       <nova:ports>
Nov 14 15:12:34 user nova-compute[75292]:         <nova:port uuid="130fb9b0-8db7-45c8-b317-da3b33d39f46">
Nov 14 15:12:34 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 15:12:34 user nova-compute[75292]:         </nova:port>
Nov 14 15:12:34 user nova-compute[75292]:       </nova:ports>
Nov 14 15:12:34 user nova-compute[75292]:     </nova:instance>
Nov 14 15:12:34 user nova-compute[75292]:   </metadata>
Nov 14 15:12:34 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:12:34 user nova-compute[75292]:     <system>
Nov 14 15:12:34 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:12:34 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:12:34 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:12:34 user nova-compute[75292]:       <entry name="serial">3905c292-28c0-4146-9a3c-b54d18b9074c</entry>
Nov 14 15:12:34 user nova-compute[75292]:       <entry name="uuid">3905c292-28c0-4146-9a3c-b54d18b9074c</entry>
Nov 14 15:12:34 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:12:34 user nova-compute[75292]:     </system>
Nov 14 15:12:34 user nova-compute[75292]:   </sysinfo>
Nov 14 15:12:34 user nova-compute[75292]:   <os>
Nov 14 15:12:34 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:12:34 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:12:34 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:12:34 user nova-compute[75292]:   </os>
Nov 14 15:12:34 user nova-compute[75292]:   <features>
Nov 14 15:12:34 user nova-compute[75292]:     <acpi/>
Nov 14 15:12:34 user nova-compute[75292]:     <apic/>
Nov 14 15:12:34 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:12:34 user nova-compute[75292]:   </features>
Nov 14 15:12:34 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:12:34 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:12:34 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:12:34 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:12:34 user nova-compute[75292]:   </clock>
Nov 14 15:12:34 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:12:34 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:12:34 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:12:34 user nova-compute[75292]:   </cpu>
Nov 14 15:12:34 user nova-compute[75292]:   <devices>
Nov 14 15:12:34 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:12:34 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:12:34 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk"/>
Nov 14 15:12:34 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:12:34 user nova-compute[75292]:     </disk>
Nov 14 15:12:34 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:12:34 user nova-compute[75292]:       <mac address="fa:16:3e:6b:7a:49"/>
Nov 14 15:12:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:12:34 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:12:34 user nova-compute[75292]:       <target dev="tap130fb9b0-8d"/>
Nov 14 15:12:34 user nova-compute[75292]:     </interface>
Nov 14 15:12:34 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:12:34 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/console.log" append="off"/>
Nov 14 15:12:34 user nova-compute[75292]:     </serial>
Nov 14 15:12:34 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:12:34 user nova-compute[75292]:     <video>
Nov 14 15:12:34 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:12:34 user nova-compute[75292]:     </video>
Nov 14 15:12:34 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:12:34 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:12:34 user nova-compute[75292]:     </rng>
Nov 14 15:12:34 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:12:34 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:12:34 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:12:34 user nova-compute[75292]:     </memballoon>
Nov 14 15:12:34 user nova-compute[75292]:   </devices>
Nov 14 15:12:34 user nova-compute[75292]: </domain>
Nov 14 15:12:34 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980037636',display_name='tempest-AttachVolumeTestJSON-server-980037636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980037636',id=51,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC23jGnBVf9EtzVj78xBfkC36/mgdQBvOHXE4QK/AIdQA5JVY9iaZN61ao2+XwrfjkMe7nxQrPPDLtL13drUtdfnLBngJCz7CV9OOhRpzPKukjFJ60lC2m35JJh/3R3zRA==',key_name='tempest-keypair-1620010421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-dceg7e0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:12:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=3905c292-28c0-4146-9a3c-b54d18b9074c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG os_vif [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de2f5380-92d9-5db7-aaf2-0ed883e5ad69', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap130fb9b0-8d, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap130fb9b0-8d, col_values=(('qos', UUID('be913b37-307d-44ca-b0b2-007a6242b33b')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap130fb9b0-8d, col_values=(('external_ids', {'iface-id': '130fb9b0-8db7-45c8-b317-da3b33d39f46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:7a:49', 'vm-uuid': '3905c292-28c0-4146-9a3c-b54d18b9074c'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:34 user nova-compute[75292]: INFO os_vif [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d')
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No VIF found with MAC fa:16:3e:6b:7a:49, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updated VIF entry in instance network info cache for port 130fb9b0-8db7-45c8-b317-da3b33d39f46. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG nova.network.neutron [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating instance_info_cache with network_info: [{"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:12:34 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-51bfc3f8-5ccd-4486-a24a-7dc4b60fcebd req-91159711-f4e3-4566-95ad-20f30732f13d service nova] Releasing lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:12:35 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Skipping network cache update for instance because it is Building. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-7379b7be-8f7c-4b6f-8ff6-813c81b7fe62 req-b0b2d883-b539-41d2-812e-633e79e68cb2 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7379b7be-8f7c-4b6f-8ff6-813c81b7fe62 req-b0b2d883-b539-41d2-812e-633e79e68cb2 service nova] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7379b7be-8f7c-4b6f-8ff6-813c81b7fe62 req-b0b2d883-b539-41d2-812e-633e79e68cb2 service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-7379b7be-8f7c-4b6f-8ff6-813c81b7fe62 req-b0b2d883-b539-41d2-812e-633e79e68cb2 service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG nova.compute.manager [req-7379b7be-8f7c-4b6f-8ff6-813c81b7fe62 req-b0b2d883-b539-41d2-812e-633e79e68cb2 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] No waiting events found dispatching network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:12:36 user nova-compute[75292]: WARNING nova.compute.manager [req-7379b7be-8f7c-4b6f-8ff6-813c81b7fe62 req-b0b2d883-b539-41d2-812e-633e79e68cb2 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received unexpected event network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 for instance with vm_state building and task_state spawning.
Nov 14 15:12:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:12:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:12:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 is timed out.
Nov 14 15:12:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config.
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMXHTbnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:12:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b85022-16a2-48b6-9769-20d9b9e498bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:12:37 user nova-compute[75292]: No targets found.
Nov 14 15:12:37 user nova-compute[75292]: iSNS:
Nov 14 15:12:37 user nova-compute[75292]: No targets found.
Nov 14 15:12:37 user nova-compute[75292]: STATIC:
Nov 14 15:12:37 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d
Nov 14 15:12:37 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:12:37 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:12:37 user nova-compute[75292]: FIRMWARE:
Nov 14 15:12:37 user nova-compute[75292]: No targets found.
Nov 14 15:12:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:12:37 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:12:37 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a467e069-b35d-4a64-ab4e-2f42597047c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f41330-ca6f-4b0d-a2ba-07f3eb173fe1]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d (non-flash)
Nov 14 15:12:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d (non-flash)
Nov 14 15:12:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c3d16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d212a7-bced-4a22-b9f3-3646780a0467]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d747623-b922-48b0-bab3-224bba5c61f8]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a3d25-8ce0-4eed-8408-0eeee9d24b62]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a054757b-c2d6-4d09-94fc-b8a31d16bdf5]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a697a7-1355-4705-a556-e55a2970023e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9de5cc-181c-4c84-ab49-98e287cac8ff]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260]
Nov 14 15:12:37 user nova-compute[75292]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d, portal: 172.16.0.220,3260] successful.
Nov 14 15:12:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8e08687-1d60-4f82-bada-784f84c1804d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdc51f-76b7-4fd6-9b4e-06c2a39ac993]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== disconnect_volume: return (283ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Instance spawned successfully.
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:12:37 user nova-compute[75292]: INFO nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 15:12:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG nova.objects.instance [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-db3b03f9-0d48-43e4-b90b-f88c5000dd57 req-772dc861-c0f1-4e4a-8971-33b7bf0d2101 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-db3b03f9-0d48-43e4-b90b-f88c5000dd57 req-772dc861-c0f1-4e4a-8971-33b7bf0d2101 service nova] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-db3b03f9-0d48-43e4-b90b-f88c5000dd57 req-772dc861-c0f1-4e4a-8971-33b7bf0d2101 service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-db3b03f9-0d48-43e4-b90b-f88c5000dd57 req-772dc861-c0f1-4e4a-8971-33b7bf0d2101 service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG nova.compute.manager [req-db3b03f9-0d48-43e4-b90b-f88c5000dd57 req-772dc861-c0f1-4e4a-8971-33b7bf0d2101 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] No waiting events found dispatching network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:12:38 user nova-compute[75292]: WARNING nova.compute.manager [req-db3b03f9-0d48-43e4-b90b-f88c5000dd57 req-772dc861-c0f1-4e4a-8971-33b7bf0d2101 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received unexpected event network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 for instance with vm_state building and task_state spawning.
Nov 14 15:12:38 user nova-compute[75292]: INFO nova.compute.manager [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Took 5.87 seconds to build instance.
Nov 14 15:12:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31818384-6f36-4358-9fb2-57b7d6e8a8e8 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.960s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-4156f21d-8c9d-4426-93dc-66c3fdd641f7 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:12:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:43 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:12:43 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:12:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:12:45 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:12:45 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.142681121826172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 3905c292-28c0-4146-9a3c-b54d18b9074c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:12:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:12:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:12:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:52 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:12:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:12:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:12:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:12:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:12:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:12:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG nova.objects.instance [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:13:08 user nova-compute[75292]: INFO nova.compute.manager [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attaching volume fef9cca3-6e94-4165-9222-463513e8132e to /dev/vdb
Nov 14 15:13:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[633cf59b-7cdc-42dd-b447-ba5ae70efdb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519dec7-7f00-4897-83c9-d197f6b86562]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8acd834-da69-41cf-a77a-2c9e51486d87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ce09e-af1c-40ba-a3da-1d371cb9db05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:13:08 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:13:08 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[be02db60-ae56-4c5e-9644-75a8d5ca8d2a]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG os_brick.utils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:13:08 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating existing volume attachment record: 83efd459-9f46-48b5-bf8c-ff94e2e0fa3a {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:13:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imJTkjlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:13:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:13:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:13:13 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17f6ecc-e996-4ae0-80ed-cb45afc8ca0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:13:13 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[338aa19e-aeda-4e58-9ac2-55a489ac94b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e] added
Nov 14 15:13:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c93da7-7ee4-498f-9d9c-0a2cc84f984b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f516f4-a0d4-4d02-a8eb-32ff176ae0d6]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imJTkjlU {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v imJTkjlU" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4284cd01-9e20-43ba-b29d-89d0443650db]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'imJTkjlU'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f4a3f-08e0-4c03-b591-85c9904e474f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f597d1-5699-464b-bcb2-d483dffacdf3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:13:13 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:13:13 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:13:13 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:13:13 user nova-compute[75292]: 
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[088210e4-db83-48c5-8202-e6fd10b1c327]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260]
Nov 14 15:13:13 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260] successful.
Nov 14 15:13:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b726b538-f736-4dab-bf9b-9cd458236541]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b4a6d-579a-436d-836e-3498e0d60c56]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e (non-flash)
Nov 14 15:13:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e (non-flash)
Nov 14 15:13:13 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c42d280-7bed-4632-a708-931b2b246c39]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:13:13 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imJTkjlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23033363763613738', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033363763613738', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG nova.objects.instance [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:13:14 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:13:14 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:13:14 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:13:14 user nova-compute[75292]:   <serial>fef9cca3-6e94-4165-9222-463513e8132e</serial>
Nov 14 15:13:14 user nova-compute[75292]: </disk>
Nov 14 15:13:14 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] No VIF found with MAC fa:16:3e:b0:8d:7b, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:13:14 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5af57f86-8ffc-4724-87ef-67a47685970d tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.199s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:13:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:13:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:13:16 user nova-compute[75292]: INFO nova.compute.manager [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Detaching volume fef9cca3-6e94-4165-9222-463513e8132e
Nov 14 15:13:16 user nova-compute[75292]: INFO nova.virt.block_device [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Attempting to driver detach volume fef9cca3-6e94-4165-9222-463513e8132e from mountpoint /dev/vdb
Nov 14 15:13:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Attempting to detach device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:13:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:13:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:13:16 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:13:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:13:16 user nova-compute[75292]:   <serial>fef9cca3-6e94-4165-9222-463513e8132e</serial>
Nov 14 15:13:16 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:13:16 user nova-compute[75292]: </disk>
Nov 14 15:13:16 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:13:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the persistent domain config.
Nov 14 15:13:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:13:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:13:16 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:13:16 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:13:16 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:13:16 user nova-compute[75292]:   <serial>fef9cca3-6e94-4165-9222-463513e8132e</serial>
Nov 14 15:13:16 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:13:16 user nova-compute[75292]: </disk>
Nov 14 15:13:16 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:13:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:13:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:31 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:13:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:13:37 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0eba59b-c83e-4378-9c24-438a509c9f95 is timed out.
Nov 14 15:13:37 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully detached device vdb from instance f0eba59b-c83e-4378-9c24-438a509c9f95 from the live domain config.
Nov 14 15:13:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'imJTkjlU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:13:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc8d1ee-799e-4588-9e7a-8eb01f35ef37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:13:37 user nova-compute[75292]: No targets found.
Nov 14 15:13:37 user nova-compute[75292]: iSNS:
Nov 14 15:13:37 user nova-compute[75292]: No targets found.
Nov 14 15:13:37 user nova-compute[75292]: STATIC:
Nov 14 15:13:37 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e
Nov 14 15:13:37 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:13:37 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:13:37 user nova-compute[75292]: FIRMWARE:
Nov 14 15:13:37 user nova-compute[75292]: No targets found.
Nov 14 15:13:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:13:37 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:13:37 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[43116d46-6d33-4e02-9a70-ef1907852367]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7720c0c1-ded8-4e3f-812e-ff833fb59be2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e (non-flash)
Nov 14 15:13:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e (non-flash)
Nov 14 15:13:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b30708430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadf455f-d6d9-42c9-9336-8a416f9c5ec7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c24126-27b4-46c7-a4b9-3c701f2bc5ac]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb77f69-5711-43c4-89c4-d0a76017d26b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4760c86c-be55-4409-adff-88de985fa3b9]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [{"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc0ad1-599b-4811-9f1d-43537210391c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-f0eba59b-c83e-4378-9c24-438a509c9f95" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dddf3d5-0e2c-49f3-91a3-3e8f4e91683e]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260]
Nov 14 15:13:37 user nova-compute[75292]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e, portal: 172.16.0.220,3260] successful.
Nov 14 15:13:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fef9cca3-6e94-4165-9222-463513e8132e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[525ebdff-dcfd-46d4-b00c-060e6bee5fa0]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] <== disconnect_volume: return (294ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:13:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:13:38 user nova-compute[75292]: DEBUG nova.objects.instance [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'flavor' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:13:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fd09e7ab-468e-4f9f-8129-f7bb183983a6 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:13:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:13:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:13:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:13:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:13:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:13:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:13:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:13:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:13:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8832MB free_disk=25.106060028076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance f0eba59b-c83e-4378-9c24-438a509c9f95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 3905c292-28c0-4146-9a3c-b54d18b9074c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:13:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:13:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:52 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:13:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:13:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:13:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:13:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:13:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:13:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:14:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:14:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:14:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:19 user nova-compute[75292]: INFO nova.compute.manager [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Terminating instance
Nov 14 15:14:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-ca967fe8-5053-4c6e-8acb-070eb4acd781 req-f16d0b60-2508-4848-a99d-65444e4709fb service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-vif-unplugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ca967fe8-5053-4c6e-8acb-070eb4acd781 req-f16d0b60-2508-4848-a99d-65444e4709fb service nova] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ca967fe8-5053-4c6e-8acb-070eb4acd781 req-f16d0b60-2508-4848-a99d-65444e4709fb service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-ca967fe8-5053-4c6e-8acb-070eb4acd781 req-f16d0b60-2508-4848-a99d-65444e4709fb service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-ca967fe8-5053-4c6e-8acb-070eb4acd781 req-f16d0b60-2508-4848-a99d-65444e4709fb service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] No waiting events found dispatching network-vif-unplugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.compute.manager [req-ca967fe8-5053-4c6e-8acb-070eb4acd781 req-f16d0b60-2508-4848-a99d-65444e4709fb service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-vif-unplugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:20 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Instance destroyed successfully.
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lazy-loading 'resources' on Instance uuid f0eba59b-c83e-4378-9c24-438a509c9f95 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:08:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1216732357',display_name='tempest-SnapshotDataIntegrityTests-server-1216732357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1216732357',id=50,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuwGd5sJg62e51ePIf6A4L+Vz+URbgX1gGBB88M4AVnrowtS9WWY55lwH91seHpppu5JvIz9XIhb05fwb+t8ZHUJeaWpGZ0PdqJH+Z9OZLBsueklwyVu6KVBerEQyoqlw==',key_name='tempest-keypair-5303087',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:08:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='342df781c42a47baa9ef6998a230b3fa',ramdisk_id='',reservation_id='r-i1c2kv2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1774387768',owner_user_name='tempest-SnapshotDataIntegrityTests-1774387768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9b7348de59a4a4a8dbf0df6de55f2fe',uuid=f0eba59b-c83e-4378-9c24-438a509c9f95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Converting VIF {"id": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "address": "fa:16:3e:b0:8d:7b", "network": {"id": "a415641c-c144-40c4-a13d-2c5a5f087855", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-321565822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "342df781c42a47baa9ef6998a230b3fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39dfa63-ba", "ovs_interfaceid": "b39dfa63-ba05-4dbf-a309-ca14c52b1daf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG os_vif [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb39dfa63-ba, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40440d40-9a82-42aa-8712-9f7576187ece) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:20 user nova-compute[75292]: INFO os_vif [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:8d:7b,bridge_name='br-int',has_traffic_filtering=True,id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf,network=Network(a415641c-c144-40c4-a13d-2c5a5f087855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39dfa63-ba')
Nov 14 15:14:20 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Deleting instance files /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95_del
Nov 14 15:14:20 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Deletion of /opt/stack/data/nova/instances/f0eba59b-c83e-4378-9c24-438a509c9f95_del complete
Nov 14 15:14:20 user nova-compute[75292]: INFO nova.compute.manager [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 15:14:20 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:14:20 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:14:21 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Took 1.03 seconds to deallocate network for instance.
Nov 14 15:14:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-2ca314f4-60b9-4067-af0a-d5674bef0858 req-51f6243e-faf4-4e1d-b487-1f35929645c4 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-vif-deleted-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:14:21 user nova-compute[75292]: INFO nova.compute.manager [req-2ca314f4-60b9-4067-af0a-d5674bef0858 req-51f6243e-faf4-4e1d-b487-1f35929645c4 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Neutron deleted interface b39dfa63-ba05-4dbf-a309-ca14c52b1daf; detaching it from the instance and deleting it from the info cache
Nov 14 15:14:21 user nova-compute[75292]: DEBUG nova.network.neutron [req-2ca314f4-60b9-4067-af0a-d5674bef0858 req-51f6243e-faf4-4e1d-b487-1f35929645c4 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-2ca314f4-60b9-4067-af0a-d5674bef0858 req-51f6243e-faf4-4e1d-b487-1f35929645c4 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Detach interface failed, port_id=b39dfa63-ba05-4dbf-a309-ca14c52b1daf, reason: Instance f0eba59b-c83e-4378-9c24-438a509c9f95 could not be found. {{(pid=75292) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:14:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:21 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Deleted allocations for instance f0eba59b-c83e-4378-9c24-438a509c9f95
Nov 14 15:14:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0020eaeb-a749-4794-b553-0044ac1c0b36 tempest-SnapshotDataIntegrityTests-1774387768 tempest-SnapshotDataIntegrityTests-1774387768-project-member] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-58d1c3d8-3e01-4d30-bdbe-3bb4521185ab req-0d6ca1cc-738a-4516-bd28-4fc8a4d45f72 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received event network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:14:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58d1c3d8-3e01-4d30-bdbe-3bb4521185ab req-0d6ca1cc-738a-4516-bd28-4fc8a4d45f72 service nova] Acquiring lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58d1c3d8-3e01-4d30-bdbe-3bb4521185ab req-0d6ca1cc-738a-4516-bd28-4fc8a4d45f72 service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-58d1c3d8-3e01-4d30-bdbe-3bb4521185ab req-0d6ca1cc-738a-4516-bd28-4fc8a4d45f72 service nova] Lock "f0eba59b-c83e-4378-9c24-438a509c9f95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:22 user nova-compute[75292]: DEBUG nova.compute.manager [req-58d1c3d8-3e01-4d30-bdbe-3bb4521185ab req-0d6ca1cc-738a-4516-bd28-4fc8a4d45f72 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] No waiting events found dispatching network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:14:22 user nova-compute[75292]: WARNING nova.compute.manager [req-58d1c3d8-3e01-4d30-bdbe-3bb4521185ab req-0d6ca1cc-738a-4516-bd28-4fc8a4d45f72 service nova] [instance: f0eba59b-c83e-4378-9c24-438a509c9f95] Received unexpected event network-vif-plugged-b39dfa63-ba05-4dbf-a309-ca14c52b1daf for instance with vm_state deleted and task_state None.
Nov 14 15:14:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-changed-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG nova.compute.manager [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Refreshing instance network info cache due to event network-changed-130fb9b0-8db7-45c8-b317-da3b33d39f46. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] Acquiring lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] Acquired lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Refreshing network info cache for port 130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updated VIF entry in instance network info cache for port 130fb9b0-8db7-45c8-b317-da3b33d39f46. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG nova.network.neutron [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating instance_info_cache with network_info: [{"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:14:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-0e576dff-65bb-4620-b00d-42f3ffb31c6a req-166477ae-9a71-47b7-8347-8c4336cb575d service nova] Releasing lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:25 user nova-compute[75292]: INFO nova.compute.manager [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attaching volume 84824839-b848-4db8-b718-1ab9fe8231c2 to /dev/vdb
Nov 14 15:14:25 user nova-compute[75292]: DEBUG os_brick.utils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2518fd9-0274-4174-9c98-3ca3c2f7b373]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57ce8b-dd03-497c-8147-433cbbc7c857]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f6cbe0-0bf2-4cfb-8f58-a33d95ce8086]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9d41a8-58d0-4731-8879-5d94c4e626d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:14:25 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:14:25 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bb1c96-2419-4bc1-8759-c48992e1940b]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG os_brick.utils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating existing volume attachment record: 44bfc970-4305-4260-aca4-8372140734f3 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHBYKMfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:14:29 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:14:29 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:14:29 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed64bd62-4d5c-4917-b5ec-6ae57cd0e831]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:14:29 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb9e29-ac7b-4f2e-b184-8f6bd3e44232]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2] added
Nov 14 15:14:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bd749a-9443-4442-85a8-760110f60db1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d42b05-4a23-498f-bfa9-ae69b8b6abb7]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHBYKMfP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHBYKMfP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[77063b85-e3da-4f7c-a954-691a52b6b3aa]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JHBYKMfP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76d64ae-3235-4168-9e83-26113b0f8e6c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a946f37f-bc85-46a1-b52b-1f3f9d48d7c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:14:29 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:14:29 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:14:29 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:14:29 user nova-compute[75292]: 
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a12e14-db32-4f75-8ed3-c3b22af471b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260]
Nov 14 15:14:29 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260] successful.
Nov 14 15:14:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0944d588-4157-445c-9efa-76d3260c8f00]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f4ebc2-d0b8-485b-b07e-0be80dab3fc3]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:14:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:14:29 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817f370-b7c7-4e1d-b211-4cf2174a2aa5]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:14:29 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHBYKMfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26231613531643138', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231613531643138', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG nova.objects.instance [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:14:30 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:14:30 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:14:30 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:14:30 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:14:30 user nova-compute[75292]:   <serial>84824839-b848-4db8-b718-1ab9fe8231c2</serial>
Nov 14 15:14:30 user nova-compute[75292]: </disk>
Nov 14 15:14:30 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:14:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:14:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:14:31 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No VIF found with MAC fa:16:3e:6b:7a:49, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:14:31 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-c68fc489-0bdd-4547-a545-6ac38b9c8ea2 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.115s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG nova.objects.instance [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:33 user nova-compute[75292]: INFO nova.compute.manager [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attaching volume 68f983c6-548b-469f-9837-881960b1f131 to /dev/vdc
Nov 14 15:14:33 user nova-compute[75292]: DEBUG os_brick.utils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e5f9ef-6bf7-4df4-b9b5-54367043bae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ec48cf-bb74-4634-9460-3ec932263d0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07db023-925d-4909-ad81-d86900a594f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70c0801-d0bd-492f-b780-02cc66206dcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:14:33 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad288372-e184-46c6-bfff-e5e1c3a04341]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG os_brick.utils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating existing volume attachment record: 9990146c-97e9-4414-9936-fbd30360fac7 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:14:33 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating instance_info_cache with network_info: [{"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-3905c292-28c0-4146-9a3c-b54d18b9074c" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCReosfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:14:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:14:37 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:14:37 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[839a6372-d968-4372-9648-5c47500ca836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:14:37 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb41692d-769b-4b02-8249-0f55f3fb1abd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131] added
Nov 14 15:14:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f6a87-54df-4669-a4a6-644b8bf182e3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f36db-b15c-4dba-8ca4-90856ebea448]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCReosfB {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCReosfB" returned: 0 in 0.031s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19882af-e817-40d3-bf44-074e9132525e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VCReosfB'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b53e8-0704-49b4-9300-e7d3424daaae]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8b1451-aa88-4c0f-9b24-d49d2d68f113]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:14:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:14:37 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:14:37 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0159e480-8031-4e6d-bc46-532726c49ea5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260]
Nov 14 15:14:38 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260] successful.
Nov 14 15:14:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[465018ef-eeb3-492a-b93f-ee25758ee005]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b66a28-5f79-4540-b15c-fa301c894f34]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:14:38 user nova-compute[75292]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)
Nov 14 15:14:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:14:38 user nova-compute[75292]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)
Nov 14 15:14:38 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e577db3-ae28-4645-a23a-847aa957fc1f]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCReosfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:14:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26165363637383630', 'path': '/dev/sdc'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165363637383630', 'path': '/dev/sdc'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.objects.instance [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:14:39 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:14:39 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:14:39 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 15:14:39 user nova-compute[75292]:   <serial>68f983c6-548b-469f-9837-881960b1f131</serial>
Nov 14 15:14:39 user nova-compute[75292]: </disk>
Nov 14 15:14:39 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] No VIF found with MAC fa:16:3e:6b:7a:49, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:14:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-5043e7dc-4966-4b4e-b7f0-e5d67f458360 tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.261s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:40 user nova-compute[75292]: INFO nova.compute.manager [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Detaching volume 84824839-b848-4db8-b718-1ab9fe8231c2
Nov 14 15:14:40 user nova-compute[75292]: INFO nova.virt.block_device [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attempting to driver detach volume 84824839-b848-4db8-b718-1ab9fe8231c2 from mountpoint /dev/vdb
Nov 14 15:14:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Attempting to detach device vdb from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:14:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:14:40 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:14:40 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:14:40 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:14:40 user nova-compute[75292]:   <serial>84824839-b848-4db8-b718-1ab9fe8231c2</serial>
Nov 14 15:14:40 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:14:40 user nova-compute[75292]: </disk>
Nov 14 15:14:40 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:14:40 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully detached device vdb from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the persistent domain config.
Nov 14 15:14:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:14:40 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:14:40 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:14:40 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:14:40 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:14:40 user nova-compute[75292]:   <serial>84824839-b848-4db8-b718-1ab9fe8231c2</serial>
Nov 14 15:14:40 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:14:40 user nova-compute[75292]: </disk>
Nov 14 15:14:40 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:14:41 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:14:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:14:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 15:14:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:45 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75292) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 15:14:46 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:14:46 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=25.132389068603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance 3905c292-28c0-4146-9a3c-b54d18b9074c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 15:14:46 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:14:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:51 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:53 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:14:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:00 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3905c292-28c0-4146-9a3c-b54d18b9074c is timed out.
Nov 14 15:15:01 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully detached device vdb from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the live domain config.
Nov 14 15:15:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHBYKMfP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:15:01 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de6f653-ce7c-4cce-b60d-0a91bb57d430]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:15:01 user nova-compute[75292]: No targets found.
Nov 14 15:15:01 user nova-compute[75292]: iSNS:
Nov 14 15:15:01 user nova-compute[75292]: No targets found.
Nov 14 15:15:01 user nova-compute[75292]: STATIC:
Nov 14 15:15:01 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131
Nov 14 15:15:01 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:15:01 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:15:01 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2
Nov 14 15:15:01 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:15:01 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:15:01 user nova-compute[75292]: FIRMWARE:
Nov 14 15:15:01 user nova-compute[75292]: No targets found.
Nov 14 15:15:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:15:01 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:15:01 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cde3af-6168-4a7a-a6ca-68b405acbdf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba7a03-146a-41f0-9ce9-f8329559d791]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:15:01 user nova-compute[75292]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)
Nov 14 15:15:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 (non-flash)
Nov 14 15:15:01 user nova-compute[75292]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)
Nov 14 15:15:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b3063beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8942cecf-c946-457a-909f-b51d32b924e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c974c217-10dc-420d-b1b8-11832e5bf450]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f237265-6091-4d60-b833-438cb26cc289]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a225ad50-dc23-43ed-881a-f30252a7a464]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[814a10f9-6768-4e1e-ac53-6a52c176a725]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfcdc97-301e-4197-9cbd-abeebf261562]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260]
Nov 14 15:15:01 user nova-compute[75292]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2, portal: 172.16.0.220,3260] successful.
Nov 14 15:15:01 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84824839-b848-4db8-b718-1ab9fe8231c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7500610-05e4-41e8-92b8-baf030adbbfd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== disconnect_volume: return (309ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:15:01 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:15:02 user nova-compute[75292]: DEBUG nova.objects.instance [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:15:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-b8f3f142-3859-4a7c-821f-95c4612e5eff tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:03 user nova-compute[75292]: INFO nova.compute.manager [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Detaching volume 68f983c6-548b-469f-9837-881960b1f131
Nov 14 15:15:03 user nova-compute[75292]: INFO nova.virt.block_device [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Attempting to driver detach volume 68f983c6-548b-469f-9837-881960b1f131 from mountpoint /dev/vdc
Nov 14 15:15:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Attempting to detach device vdc from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:15:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:15:03 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:15:03 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:15:03 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 15:15:03 user nova-compute[75292]:   <serial>68f983c6-548b-469f-9837-881960b1f131</serial>
Nov 14 15:15:03 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 15:15:03 user nova-compute[75292]: </disk>
Nov 14 15:15:03 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:15:03 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully detached device vdc from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the persistent domain config.
Nov 14 15:15:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:15:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:15:03 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:15:03 user nova-compute[75292]:   <source dev="/dev/sdc"/>
Nov 14 15:15:03 user nova-compute[75292]:   <target dev="vdc" bus="virtio"/>
Nov 14 15:15:03 user nova-compute[75292]:   <serial>68f983c6-548b-469f-9837-881960b1f131</serial>
Nov 14 15:15:03 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 15:15:03 user nova-compute[75292]: </disk>
Nov 14 15:15:03 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:15:03 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:15:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:15:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 15:15:05 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 15:15:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:23 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3905c292-28c0-4146-9a3c-b54d18b9074c is timed out.
Nov 14 15:15:23 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully detached device vdc from instance 3905c292-28c0-4146-9a3c-b54d18b9074c from the live domain config.
Nov 14 15:15:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCReosfB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:15:23 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95dd072-9578-4075-a664-4aa7218d963f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:15:23 user nova-compute[75292]: No targets found.
Nov 14 15:15:23 user nova-compute[75292]: iSNS:
Nov 14 15:15:23 user nova-compute[75292]: No targets found.
Nov 14 15:15:23 user nova-compute[75292]: STATIC:
Nov 14 15:15:23 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131
Nov 14 15:15:23 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:15:23 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:15:23 user nova-compute[75292]: FIRMWARE:
Nov 14 15:15:23 user nova-compute[75292]: No targets found.
Nov 14 15:15:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:15:23 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:15:23 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[270905c4-b913-4df6-8787-12583cb5d7c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f8cac8-5482-4483-af8b-0c2d9fdfedea]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)
Nov 14 15:15:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 (non-flash)
Nov 14 15:15:23 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b3070b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131'): ({'sdc'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Removing single pathed devices sdc {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8bbb62-08be-415a-83dc-64c055420dae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcc7664-02ea-48ac-94f3-b811d00449d8]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Flushing IO for device /dev/sdc {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:15:23 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98809ac-e08a-48cf-808e-32731cb5f584]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b009ad-a5d3-4c2f-8ba3-2464f058970b]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] SCSI volumes sdc have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70dac54-4ae8-412c-b93e-cf7cc3b6a867]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b668e1-e707-4e71-83e0-5cb21896acc3]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260]
Nov 14 15:15:24 user nova-compute[75292]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131, portal: 172.16.0.220,3260] successful.
Nov 14 15:15:24 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68f983c6-548b-469f-9837-881960b1f131 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3367c9-1e83-45fd-8cc3-a8c451f86266]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] <== disconnect_volume: return (303ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG nova.objects.instance [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'flavor' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:15:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-95554d7f-2ea6-4111-a896-74f7c5aef99b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.618s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:26 user nova-compute[75292]: INFO nova.compute.manager [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Terminating instance
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.compute.manager [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cb4e62a-f927-4a1f-91e0-8b76cbdd8cb8 req-0d2caa3b-886b-4437-b0cb-2b0c786b7496 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-vif-unplugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cb4e62a-f927-4a1f-91e0-8b76cbdd8cb8 req-0d2caa3b-886b-4437-b0cb-2b0c786b7496 service nova] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cb4e62a-f927-4a1f-91e0-8b76cbdd8cb8 req-0d2caa3b-886b-4437-b0cb-2b0c786b7496 service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-8cb4e62a-f927-4a1f-91e0-8b76cbdd8cb8 req-0d2caa3b-886b-4437-b0cb-2b0c786b7496 service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cb4e62a-f927-4a1f-91e0-8b76cbdd8cb8 req-0d2caa3b-886b-4437-b0cb-2b0c786b7496 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] No waiting events found dispatching network-vif-unplugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.compute.manager [req-8cb4e62a-f927-4a1f-91e0-8b76cbdd8cb8 req-0d2caa3b-886b-4437-b0cb-2b0c786b7496 service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-vif-unplugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Instance destroyed successfully.
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.objects.instance [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lazy-loading 'resources' on Instance uuid 3905c292-28c0-4146-9a3c-b54d18b9074c {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:12:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-980037636',display_name='tempest-AttachVolumeTestJSON-server-980037636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-980037636',id=51,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC23jGnBVf9EtzVj78xBfkC36/mgdQBvOHXE4QK/AIdQA5JVY9iaZN61ao2+XwrfjkMe7nxQrPPDLtL13drUtdfnLBngJCz7CV9OOhRpzPKukjFJ60lC2m35JJh/3R3zRA==',key_name='tempest-keypair-1620010421',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:12:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e54ddffd17e449719cf8caaac639adc0',ramdisk_id='',reservation_id='r-dceg7e0d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2139193622',owner_user_name='tempest-AttachVolumeTestJSON-2139193622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:12:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3dbc24e3bc2446fb9c633b220a9de990',uuid=3905c292-28c0-4146-9a3c-b54d18b9074c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converting VIF {"id": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "address": "fa:16:3e:6b:7a:49", "network": {"id": "c2e2c8ee-f9da-4669-8f0d-67624fc10af1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1589505016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e54ddffd17e449719cf8caaac639adc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap130fb9b0-8d", "ovs_interfaceid": "130fb9b0-8db7-45c8-b317-da3b33d39f46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG os_vif [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap130fb9b0-8d, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be913b37-307d-44ca-b0b2-007a6242b33b) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:15:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:15:26 user nova-compute[75292]: INFO os_vif [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:7a:49,bridge_name='br-int',has_traffic_filtering=True,id=130fb9b0-8db7-45c8-b317-da3b33d39f46,network=Network(c2e2c8ee-f9da-4669-8f0d-67624fc10af1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap130fb9b0-8d')
Nov 14 15:15:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Deleting instance files /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c_del
Nov 14 15:15:26 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Deletion of /opt/stack/data/nova/instances/3905c292-28c0-4146-9a3c-b54d18b9074c_del complete
Nov 14 15:15:27 user nova-compute[75292]: INFO nova.compute.manager [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 15:15:27 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:15:27 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Took 0.68 seconds to deallocate network for instance.
Nov 14 15:15:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:15:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:27 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Deleted allocations for instance 3905c292-28c0-4146-9a3c-b54d18b9074c
Nov 14 15:15:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-fb09b8bd-e4d9-44f3-a28e-ca0b8bcfdc4b tempest-AttachVolumeTestJSON-2139193622 tempest-AttachVolumeTestJSON-2139193622-project-member] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.806s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:15:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] Acquiring lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] Lock "3905c292-28c0-4146-9a3c-b54d18b9074c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] No waiting events found dispatching network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:15:28 user nova-compute[75292]: WARNING nova.compute.manager [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received unexpected event network-vif-plugged-130fb9b0-8db7-45c8-b317-da3b33d39f46 for instance with vm_state deleted and task_state None.
Nov 14 15:15:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-260e9515-f97e-4b1a-9e0f-88902b887d6c req-3fef4f80-d983-4b32-9d38-57f0c3685a5f service nova] [instance: 3905c292-28c0-4146-9a3c-b54d18b9074c] Received event network-vif-deleted-130fb9b0-8db7-45c8-b317-da3b33d39f46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:15:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:35 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:15:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:15:36 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:15:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:15:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:15:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:46 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:15:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:15:47 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:15:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9125MB free_disk=25.158607482910156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:15:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:15:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:52 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:15:53 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:55 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:15:57 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:02 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:16:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:16:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:16:07 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:12 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:17 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:16:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:16:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:16:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:32 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:34 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:16:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:16:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:16:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:42 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:16:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:16:48 user nova-compute[75292]: INFO nova.compute.claims [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Claim successful on node user
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:16:48 user nova-compute[75292]: DEBUG nova.network.neutron [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:16:48 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:16:49 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:16:49 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=25.148468017578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance d8be11f1-4910-4344-8be0-3a76cf2c44a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:16:49 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Creating image(s)
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "/opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "/opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.policy [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6538dda9616a4e7281d7cb44fda9b3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2baf4de9e2414ab2a717df82fdc1d863', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.187s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.204s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk 1073741824" returned: 0 in 0.053s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.169s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Cannot resize image /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Ensure instance console log exists: /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:50 user nova-compute[75292]: DEBUG nova.network.neutron [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Successfully created port: fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Successfully updated port: fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquired lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-changed-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.compute.manager [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Refreshing instance network info cache due to event network-changed-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] Acquiring lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.neutron [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Updating instance_info_cache with network_info: [{"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Releasing lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Instance network_info: |[{"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] Acquired lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.neutron [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Refreshing network info cache for port fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Start _get_guest_xml network_info=[{"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:16:51 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:16:51 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2127708825',display_name='tempest-VolumesNegativeTest-instance-2127708825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2127708825',id=52,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2baf4de9e2414ab2a717df82fdc1d863',ramdisk_id='',reservation_id='r-s14wqd0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-487268366',owner_user_name='tempest-VolumesNegativeTest-487268366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:16:49Z,user_data=None,user_id='6538dda9616a4e7281d7cb44fda9b3bd',uuid=d8be11f1-4910-4344-8be0-3a76cf2c44a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Converting VIF {"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.objects.instance [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lazy-loading 'pci_devices' on Instance uuid d8be11f1-4910-4344-8be0-3a76cf2c44a8 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:16:51 user nova-compute[75292]:   <uuid>d8be11f1-4910-4344-8be0-3a76cf2c44a8</uuid>
Nov 14 15:16:51 user nova-compute[75292]:   <name>instance-00000034</name>
Nov 14 15:16:51 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:16:51 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:16:51 user nova-compute[75292]:   <metadata>
Nov 14 15:16:51 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:16:51 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:16:51 user nova-compute[75292]:       <nova:name>tempest-VolumesNegativeTest-instance-2127708825</nova:name>
Nov 14 15:16:51 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:16:51</nova:creationTime>
Nov 14 15:16:51 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:16:51 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:16:51 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:16:51 user nova-compute[75292]:       <nova:owner>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:user uuid="6538dda9616a4e7281d7cb44fda9b3bd">tempest-VolumesNegativeTest-487268366-project-member</nova:user>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:project uuid="2baf4de9e2414ab2a717df82fdc1d863">tempest-VolumesNegativeTest-487268366</nova:project>
Nov 14 15:16:51 user nova-compute[75292]:       </nova:owner>
Nov 14 15:16:51 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:16:51 user nova-compute[75292]:       <nova:ports>
Nov 14 15:16:51 user nova-compute[75292]:         <nova:port uuid="fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75">
Nov 14 15:16:51 user nova-compute[75292]:           <nova:ip type="fixed" address="192.168.233.208" ipVersion="4"/>
Nov 14 15:16:51 user nova-compute[75292]:         </nova:port>
Nov 14 15:16:51 user nova-compute[75292]:       </nova:ports>
Nov 14 15:16:51 user nova-compute[75292]:     </nova:instance>
Nov 14 15:16:51 user nova-compute[75292]:   </metadata>
Nov 14 15:16:51 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:16:51 user nova-compute[75292]:     <system>
Nov 14 15:16:51 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:16:51 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:16:51 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:16:51 user nova-compute[75292]:       <entry name="serial">d8be11f1-4910-4344-8be0-3a76cf2c44a8</entry>
Nov 14 15:16:51 user nova-compute[75292]:       <entry name="uuid">d8be11f1-4910-4344-8be0-3a76cf2c44a8</entry>
Nov 14 15:16:51 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:16:51 user nova-compute[75292]:     </system>
Nov 14 15:16:51 user nova-compute[75292]:   </sysinfo>
Nov 14 15:16:51 user nova-compute[75292]:   <os>
Nov 14 15:16:51 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:16:51 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:16:51 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:16:51 user nova-compute[75292]:   </os>
Nov 14 15:16:51 user nova-compute[75292]:   <features>
Nov 14 15:16:51 user nova-compute[75292]:     <acpi/>
Nov 14 15:16:51 user nova-compute[75292]:     <apic/>
Nov 14 15:16:51 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:16:51 user nova-compute[75292]:   </features>
Nov 14 15:16:51 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:16:51 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:16:51 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:16:51 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:16:51 user nova-compute[75292]:   </clock>
Nov 14 15:16:51 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:16:51 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:16:51 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:16:51 user nova-compute[75292]:   </cpu>
Nov 14 15:16:51 user nova-compute[75292]:   <devices>
Nov 14 15:16:51 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:16:51 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:16:51 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk"/>
Nov 14 15:16:51 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:16:51 user nova-compute[75292]:     </disk>
Nov 14 15:16:51 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:16:51 user nova-compute[75292]:       <mac address="fa:16:3e:33:0a:7c"/>
Nov 14 15:16:51 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:16:51 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:16:51 user nova-compute[75292]:       <target dev="tapfedfcb74-1a"/>
Nov 14 15:16:51 user nova-compute[75292]:     </interface>
Nov 14 15:16:51 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:16:51 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/console.log" append="off"/>
Nov 14 15:16:51 user nova-compute[75292]:     </serial>
Nov 14 15:16:51 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:16:51 user nova-compute[75292]:     <video>
Nov 14 15:16:51 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:16:51 user nova-compute[75292]:     </video>
Nov 14 15:16:51 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:16:51 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:16:51 user nova-compute[75292]:     </rng>
Nov 14 15:16:51 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:16:51 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:16:51 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:16:51 user nova-compute[75292]:     </memballoon>
Nov 14 15:16:51 user nova-compute[75292]:   </devices>
Nov 14 15:16:51 user nova-compute[75292]: </domain>
Nov 14 15:16:51 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2127708825',display_name='tempest-VolumesNegativeTest-instance-2127708825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2127708825',id=52,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2baf4de9e2414ab2a717df82fdc1d863',ramdisk_id='',reservation_id='r-s14wqd0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-487268366',owner_user_name='tempest-VolumesNegativeTest-487268366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:16:49Z,user_data=None,user_id='6538dda9616a4e7281d7cb44fda9b3bd',uuid=d8be11f1-4910-4344-8be0-3a76cf2c44a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Converting VIF {"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG os_vif [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a338e831-374c-570c-b5ec-f48218fe01c9', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfedfcb74-1a, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfedfcb74-1a, col_values=(('qos', UUID('4b249691-c90b-4aa0-b8e1-d31523ba6386')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfedfcb74-1a, col_values=(('external_ids', {'iface-id': 'fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:0a:7c', 'vm-uuid': 'd8be11f1-4910-4344-8be0-3a76cf2c44a8'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:51 user nova-compute[75292]: INFO os_vif [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a')
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:16:51 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] No VIF found with MAC fa:16:3e:33:0a:7c, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:16:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Updated VIF entry in instance network info cache for port fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:16:52 user nova-compute[75292]: DEBUG nova.network.neutron [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Updating instance_info_cache with network_info: [{"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:16:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-3eb09162-b3af-4909-9f64-0d2cfd0831d4 req-2fe2dd36-d553-4e9f-9204-e1203d464d05 service nova] Releasing lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c69d401-50ca-48c0-b36c-b0f0ecde1dcd req-af6b3d9e-2735-485d-b15b-0b33835e0c25 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c69d401-50ca-48c0-b36c-b0f0ecde1dcd req-af6b3d9e-2735-485d-b15b-0b33835e0c25 service nova] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c69d401-50ca-48c0-b36c-b0f0ecde1dcd req-af6b3d9e-2735-485d-b15b-0b33835e0c25 service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c69d401-50ca-48c0-b36c-b0f0ecde1dcd req-af6b3d9e-2735-485d-b15b-0b33835e0c25 service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c69d401-50ca-48c0-b36c-b0f0ecde1dcd req-af6b3d9e-2735-485d-b15b-0b33835e0c25 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] No waiting events found dispatching network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:16:53 user nova-compute[75292]: WARNING nova.compute.manager [req-5c69d401-50ca-48c0-b36c-b0f0ecde1dcd req-af6b3d9e-2735-485d-b15b-0b33835e0c25 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received unexpected event network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 for instance with vm_state building and task_state spawning.
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:16:55 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Instance spawned successfully.
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:16:55 user nova-compute[75292]: INFO nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:16:55 user nova-compute[75292]: INFO nova.compute.manager [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Took 6.83 seconds to build instance.
Nov 14 15:16:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-25241ba7-0435-4bd9-9ec2-a152965267f4 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.939s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-9b438eca-4f02-4fc6-a890-cf8f0255f48a req-d5dc63c6-2439-4375-85a0-ad06996c0380 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9b438eca-4f02-4fc6-a890-cf8f0255f48a req-d5dc63c6-2439-4375-85a0-ad06996c0380 service nova] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9b438eca-4f02-4fc6-a890-cf8f0255f48a req-d5dc63c6-2439-4375-85a0-ad06996c0380 service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9b438eca-4f02-4fc6-a890-cf8f0255f48a req-d5dc63c6-2439-4375-85a0-ad06996c0380 service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:16:55 user nova-compute[75292]: DEBUG nova.compute.manager [req-9b438eca-4f02-4fc6-a890-cf8f0255f48a req-d5dc63c6-2439-4375-85a0-ad06996c0380 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] No waiting events found dispatching network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:16:55 user nova-compute[75292]: WARNING nova.compute.manager [req-9b438eca-4f02-4fc6-a890-cf8f0255f48a req-d5dc63c6-2439-4375-85a0-ad06996c0380 service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received unexpected event network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 for instance with vm_state active and task_state None.
Nov 14 15:16:56 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:56 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:16:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:30 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:36 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:17:39 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid d8be11f1-4910-4344-8be0-3a76cf2c44a8 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:17:40 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Updating instance_info_cache with network_info: [{"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:17:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-d8be11f1-4910-4344-8be0-3a76cf2c44a8" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:17:40 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:17:41 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:17:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:17:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:46 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:17:49 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:17:50 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:17:50 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.11908721923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance d8be11f1-4910-4344-8be0-3a76cf2c44a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:17:50 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:17:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:17:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:17:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:17:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:17:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:17:51 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:17:56 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:17:56 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:17:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:06 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:11 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:16 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:26 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:31 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:18:36 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:38 user nova-compute[75292]: INFO nova.compute.manager [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Terminating instance
Nov 14 15:18:38 user nova-compute[75292]: DEBUG nova.compute.manager [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:38 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-68e5643b-55e3-41bf-a707-8611e212cfde req-1bcd5fe3-8d80-4d76-b6de-2a0e4588ff4a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-vif-unplugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-68e5643b-55e3-41bf-a707-8611e212cfde req-1bcd5fe3-8d80-4d76-b6de-2a0e4588ff4a service nova] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-68e5643b-55e3-41bf-a707-8611e212cfde req-1bcd5fe3-8d80-4d76-b6de-2a0e4588ff4a service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-68e5643b-55e3-41bf-a707-8611e212cfde req-1bcd5fe3-8d80-4d76-b6de-2a0e4588ff4a service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-68e5643b-55e3-41bf-a707-8611e212cfde req-1bcd5fe3-8d80-4d76-b6de-2a0e4588ff4a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] No waiting events found dispatching network-vif-unplugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.compute.manager [req-68e5643b-55e3-41bf-a707-8611e212cfde req-1bcd5fe3-8d80-4d76-b6de-2a0e4588ff4a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-vif-unplugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Instance destroyed successfully.
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.objects.instance [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lazy-loading 'resources' on Instance uuid d8be11f1-4910-4344-8be0-3a76cf2c44a8 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2127708825',display_name='tempest-VolumesNegativeTest-instance-2127708825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2127708825',id=52,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:16:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2baf4de9e2414ab2a717df82fdc1d863',ramdisk_id='',reservation_id='r-s14wqd0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-487268366',owner_user_name='tempest-VolumesNegativeTest-487268366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:16:55Z,user_data=None,user_id='6538dda9616a4e7281d7cb44fda9b3bd',uuid=d8be11f1-4910-4344-8be0-3a76cf2c44a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Converting VIF {"id": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "address": "fa:16:3e:33:0a:7c", "network": {"id": "11c5d548-67a2-492b-96c2-1cc72b6bb770", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "79fccc9089e6452aab553a661a3ccdd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfedfcb74-1a", "ovs_interfaceid": "fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG os_vif [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfedfcb74-1a, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b249691-c90b-4aa0-b8e1-d31523ba6386) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:18:39 user nova-compute[75292]: INFO os_vif [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:0a:7c,bridge_name='br-int',has_traffic_filtering=True,id=fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75,network=Network(11c5d548-67a2-492b-96c2-1cc72b6bb770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfedfcb74-1a')
Nov 14 15:18:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Deleting instance files /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8_del
Nov 14 15:18:39 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Deletion of /opt/stack/data/nova/instances/d8be11f1-4910-4344-8be0-3a76cf2c44a8_del complete
Nov 14 15:18:39 user nova-compute[75292]: INFO nova.compute.manager [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 15:18:39 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:18:39 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:18:40 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:18:40 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Took 0.52 seconds to deallocate network for instance.
Nov 14 15:18:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:40 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:18:40 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:18:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:40 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Deleted allocations for instance d8be11f1-4910-4344-8be0-3a76cf2c44a8
Nov 14 15:18:40 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-31b259fd-9d44-49f2-a3df-68a20b303ce3 tempest-VolumesNegativeTest-487268366 tempest-VolumesNegativeTest-487268366-project-member] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.662s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] Acquiring lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] Lock "d8be11f1-4910-4344-8be0-3a76cf2c44a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] No waiting events found dispatching network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:18:41 user nova-compute[75292]: WARNING nova.compute.manager [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received unexpected event network-vif-plugged-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 for instance with vm_state deleted and task_state None.
Nov 14 15:18:41 user nova-compute[75292]: DEBUG nova.compute.manager [req-5c40dbd2-ce3f-40da-9e92-87790f5e86ed req-ab9bdff9-d91a-4bc0-9274-cda22524311a service nova] [instance: d8be11f1-4910-4344-8be0-3a76cf2c44a8] Received event network-vif-deleted-fedfcb74-1ad1-4a9b-bc49-b8bc7423aa75 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:18:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:18:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:18:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:18:51 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:51 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:18:52 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:18:52 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:18:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9134MB free_disk=25.146339416503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:18:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:18:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:18:56 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:18:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:19:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:19:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:19:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:19:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:19:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:19:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:37 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:19:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:19:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:19:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 15:19:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:19:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:49 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:51 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:19:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:19:51 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:19:51 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:19:52 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:19:52 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9224MB free_disk=25.150501251220703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:19:52 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.417s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:19:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:57 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:57 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:19:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:19:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:19:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:19:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:19:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:19:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:01 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:05 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:09 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 15:20:09 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 15:20:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Starting instance... {{(pid=75292) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75292) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 15:20:16 user nova-compute[75292]: INFO nova.compute.claims [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Claim successful on node user
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Start building networks asynchronously for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Allocating IP information in the background. {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] allocate_for_instance() {{(pid=75292) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 15:20:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Start building block device mappings for instance. {{(pid=75292) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.policy [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '133ae7119b244ca39b451f776fd82545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7719e42290482db2d36bfd5083dbe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75292) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Start spawning the instance on the hypervisor. {{(pid=75292) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Creating instance directory {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 15:20:16 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Creating image(s)
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "/opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "/opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.183s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "fb878b94ece503b57f28f42056b4088113d4123b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk 1073741824 {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b,backing_fmt=raw /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk 1073741824" returned: 0 in 0.048s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "fb878b94ece503b57f28f42056b4088113d4123b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb878b94ece503b57f28f42056b4088113d4123b --force-share --output=json" returned: 0 in 0.193s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk. size=1073741824 {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG nova.virt.disk.api [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Cannot resize image /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk to a smaller size. {{(pid=75292) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Created local disks {{(pid=75292) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Ensure instance console log exists: /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/console.log {{(pid=75292) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:17 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Successfully created port: b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 15:20:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Successfully updated port: b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 15:20:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:20:18 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:20:18 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Building network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-changed-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.compute.manager [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Refreshing instance network info cache due to event network-changed-b995b3cf-f8b1-431c-8030-549bb2808c46. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Instance cache missing network info. {{(pid=75292) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.neutron [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Instance network_info: |[{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75292) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Refreshing network info cache for port b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Start _get_guest_xml network_info=[{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'encryption_options': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'guest_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': 'bf213fca-dee8-42b3-bde7-bb229ab5915b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 15:20:19 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:20:19 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CPU controller missing on host. {{(pid=75292) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.host [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CPU controller found on host. {{(pid=75292) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75292) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T14:29:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T14:29:27Z,direct_url=<?>,disk_format='qcow2',id=bf213fca-dee8-42b3-bde7-bb229ab5915b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='79fccc9089e6452aab553a661a3ccdd2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T14:29:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Flavor limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Image limits 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Flavor pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Image pref 0:0:0 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75292) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Got 1 possible topologies {{(pid=75292) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.hardware [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75292) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1452767995',display_name='tempest-SnapshotDataIntegrityTests-server-1452767995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1452767995',id=53,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwkIDgaX6S6Yus6tqbCRIZ9PgcfIbobhShXYQYfWXyXalEy3Md3S9RRXYjVJq3RqkeZELqSSJx4jDpuwq5zw2IV6G/1H8sWQCkv/ze4LkoflWfE/1Who7h1eXXwBz00gA==',key_name='tempest-keypair-391824685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7719e42290482db2d36bfd5083dbe2',ramdisk_id='',reservation_id='r-jc83x3fb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-126930450',owner_user_name='tempest-SnapshotDataIntegrityTests-126930450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='133ae7119b244ca39b451f776fd82545',uuid=cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75292) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Converting VIF {"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'pci_devices' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 15:20:19 user nova-compute[75292]:   <uuid>cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1</uuid>
Nov 14 15:20:19 user nova-compute[75292]:   <name>instance-00000035</name>
Nov 14 15:20:19 user nova-compute[75292]:   <memory>524288</memory>
Nov 14 15:20:19 user nova-compute[75292]:   <vcpu>1</vcpu>
Nov 14 15:20:19 user nova-compute[75292]:   <metadata>
Nov 14 15:20:19 user nova-compute[75292]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 15:20:19 user nova-compute[75292]:       <nova:package version="0.0.0"/>
Nov 14 15:20:19 user nova-compute[75292]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1452767995</nova:name>
Nov 14 15:20:19 user nova-compute[75292]:       <nova:creationTime>2023-11-14 15:20:19</nova:creationTime>
Nov 14 15:20:19 user nova-compute[75292]:       <nova:flavor name="m1.tiny">
Nov 14 15:20:19 user nova-compute[75292]:         <nova:memory>512</nova:memory>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:disk>1</nova:disk>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:swap>0</nova:swap>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:vcpus>1</nova:vcpus>
Nov 14 15:20:19 user nova-compute[75292]:       </nova:flavor>
Nov 14 15:20:19 user nova-compute[75292]:       <nova:owner>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:user uuid="133ae7119b244ca39b451f776fd82545">tempest-SnapshotDataIntegrityTests-126930450-project-member</nova:user>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:project uuid="cb7719e42290482db2d36bfd5083dbe2">tempest-SnapshotDataIntegrityTests-126930450</nova:project>
Nov 14 15:20:19 user nova-compute[75292]:       </nova:owner>
Nov 14 15:20:19 user nova-compute[75292]:       <nova:root type="image" uuid="bf213fca-dee8-42b3-bde7-bb229ab5915b"/>
Nov 14 15:20:19 user nova-compute[75292]:       <nova:ports>
Nov 14 15:20:19 user nova-compute[75292]:         <nova:port uuid="b995b3cf-f8b1-431c-8030-549bb2808c46">
Nov 14 15:20:19 user nova-compute[75292]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 15:20:19 user nova-compute[75292]:         </nova:port>
Nov 14 15:20:19 user nova-compute[75292]:       </nova:ports>
Nov 14 15:20:19 user nova-compute[75292]:     </nova:instance>
Nov 14 15:20:19 user nova-compute[75292]:   </metadata>
Nov 14 15:20:19 user nova-compute[75292]:   <sysinfo type="smbios">
Nov 14 15:20:19 user nova-compute[75292]:     <system>
Nov 14 15:20:19 user nova-compute[75292]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 15:20:19 user nova-compute[75292]:       <entry name="product">OpenStack Nova</entry>
Nov 14 15:20:19 user nova-compute[75292]:       <entry name="version">0.0.0</entry>
Nov 14 15:20:19 user nova-compute[75292]:       <entry name="serial">cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1</entry>
Nov 14 15:20:19 user nova-compute[75292]:       <entry name="uuid">cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1</entry>
Nov 14 15:20:19 user nova-compute[75292]:       <entry name="family">Virtual Machine</entry>
Nov 14 15:20:19 user nova-compute[75292]:     </system>
Nov 14 15:20:19 user nova-compute[75292]:   </sysinfo>
Nov 14 15:20:19 user nova-compute[75292]:   <os>
Nov 14 15:20:19 user nova-compute[75292]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 15:20:19 user nova-compute[75292]:     <boot dev="hd"/>
Nov 14 15:20:19 user nova-compute[75292]:     <smbios mode="sysinfo"/>
Nov 14 15:20:19 user nova-compute[75292]:   </os>
Nov 14 15:20:19 user nova-compute[75292]:   <features>
Nov 14 15:20:19 user nova-compute[75292]:     <acpi/>
Nov 14 15:20:19 user nova-compute[75292]:     <apic/>
Nov 14 15:20:19 user nova-compute[75292]:     <vmcoreinfo/>
Nov 14 15:20:19 user nova-compute[75292]:   </features>
Nov 14 15:20:19 user nova-compute[75292]:   <clock offset="utc">
Nov 14 15:20:19 user nova-compute[75292]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 15:20:19 user nova-compute[75292]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 15:20:19 user nova-compute[75292]:     <timer name="hpet" present="no"/>
Nov 14 15:20:19 user nova-compute[75292]:   </clock>
Nov 14 15:20:19 user nova-compute[75292]:   <cpu mode="custom" match="exact">
Nov 14 15:20:19 user nova-compute[75292]:     <model>Nehalem</model>
Nov 14 15:20:19 user nova-compute[75292]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 15:20:19 user nova-compute[75292]:   </cpu>
Nov 14 15:20:19 user nova-compute[75292]:   <devices>
Nov 14 15:20:19 user nova-compute[75292]:     <disk type="file" device="disk">
Nov 14 15:20:19 user nova-compute[75292]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 15:20:19 user nova-compute[75292]:       <source file="/opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk"/>
Nov 14 15:20:19 user nova-compute[75292]:       <target dev="vda" bus="virtio"/>
Nov 14 15:20:19 user nova-compute[75292]:     </disk>
Nov 14 15:20:19 user nova-compute[75292]:     <interface type="ethernet">
Nov 14 15:20:19 user nova-compute[75292]:       <mac address="fa:16:3e:cc:71:a1"/>
Nov 14 15:20:19 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:20:19 user nova-compute[75292]:       <mtu size="1442"/>
Nov 14 15:20:19 user nova-compute[75292]:       <target dev="tapb995b3cf-f8"/>
Nov 14 15:20:19 user nova-compute[75292]:     </interface>
Nov 14 15:20:19 user nova-compute[75292]:     <serial type="pty">
Nov 14 15:20:19 user nova-compute[75292]:       <log file="/opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/console.log" append="off"/>
Nov 14 15:20:19 user nova-compute[75292]:     </serial>
Nov 14 15:20:19 user nova-compute[75292]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 15:20:19 user nova-compute[75292]:     <video>
Nov 14 15:20:19 user nova-compute[75292]:       <model type="virtio"/>
Nov 14 15:20:19 user nova-compute[75292]:     </video>
Nov 14 15:20:19 user nova-compute[75292]:     <rng model="virtio">
Nov 14 15:20:19 user nova-compute[75292]:       <backend model="random">/dev/urandom</backend>
Nov 14 15:20:19 user nova-compute[75292]:     </rng>
Nov 14 15:20:19 user nova-compute[75292]:     <controller type="usb" index="0" model="none"/>
Nov 14 15:20:19 user nova-compute[75292]:     <memballoon model="virtio">
Nov 14 15:20:19 user nova-compute[75292]:       <stats period="10"/>
Nov 14 15:20:19 user nova-compute[75292]:     </memballoon>
Nov 14 15:20:19 user nova-compute[75292]:   </devices>
Nov 14 15:20:19 user nova-compute[75292]: </domain>
Nov 14 15:20:19 user nova-compute[75292]:  {{(pid=75292) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1452767995',display_name='tempest-SnapshotDataIntegrityTests-server-1452767995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1452767995',id=53,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwkIDgaX6S6Yus6tqbCRIZ9PgcfIbobhShXYQYfWXyXalEy3Md3S9RRXYjVJq3RqkeZELqSSJx4jDpuwq5zw2IV6G/1H8sWQCkv/ze4LkoflWfE/1Who7h1eXXwBz00gA==',key_name='tempest-keypair-391824685',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7719e42290482db2d36bfd5083dbe2',ramdisk_id='',reservation_id='r-jc83x3fb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-126930450',owner_user_name='tempest-SnapshotDataIntegrityTests-126930450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T15:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='133ae7119b244ca39b451f776fd82545',uuid=cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Converting VIF {"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG os_vif [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8') {{(pid=75292) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0f0dc8b-22d7-574f-bc1d-46e42e57291d', '_type': 'linux-noop'}}, row=False) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb995b3cf-f8, may_exist=True, interface_attrs={}) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb995b3cf-f8, col_values=(('qos', UUID('fe82548a-e591-4920-a302-01eb0bc254e9')),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb995b3cf-f8, col_values=(('external_ids', {'iface-id': 'b995b3cf-f8b1-431c-8030-549bb2808c46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:71:a1', 'vm-uuid': 'cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1'}),), if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:19 user nova-compute[75292]: INFO os_vif [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8')
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No VIF found with MAC fa:16:3e:cc:71:a1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated VIF entry in instance network info cache for port b995b3cf-f8b1-431c-8030-549bb2808c46. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG nova.network.neutron [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:20:19 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-77a031fb-0167-4f2e-8076-0096b4a0e582 req-51c35df3-10bf-450d-8258-8bae1f89385e service nova] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:20:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-5148d4c6-a15f-430e-aa72-f499246f3873 req-535cfe56-2547-4ebe-ae70-248c0b468d13 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5148d4c6-a15f-430e-aa72-f499246f3873 req-535cfe56-2547-4ebe-ae70-248c0b468d13 service nova] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5148d4c6-a15f-430e-aa72-f499246f3873 req-535cfe56-2547-4ebe-ae70-248c0b468d13 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-5148d4c6-a15f-430e-aa72-f499246f3873 req-535cfe56-2547-4ebe-ae70-248c0b468d13 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG nova.compute.manager [req-5148d4c6-a15f-430e-aa72-f499246f3873 req-535cfe56-2547-4ebe-ae70-248c0b468d13 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] No waiting events found dispatching network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:20:21 user nova-compute[75292]: WARNING nova.compute.manager [req-5148d4c6-a15f-430e-aa72-f499246f3873 req-535cfe56-2547-4ebe-ae70-248c0b468d13 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received unexpected event network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 for instance with vm_state building and task_state spawning.
Nov 14 15:20:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:21 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Instance event wait completed in 0 seconds for  {{(pid=75292) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Guest created on hypervisor {{(pid=75292) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 15:20:23 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Instance spawned successfully.
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Found default for hw_cdrom_bus of ide {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Found default for hw_disk_bus of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Found default for hw_input_bus of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Found default for hw_pointer_model of None {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Found default for hw_video_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Found default for hw_vif_model of virtio {{(pid=75292) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 15:20:23 user nova-compute[75292]: INFO nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Checking state {{(pid=75292) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 15:20:23 user nova-compute[75292]: INFO nova.compute.manager [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Took 6.87 seconds to build instance.
Nov 14 15:20:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d0f6b824-0867-4952-b65e-7220b7940f0c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.991s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-6234ab8b-01a5-453b-92ee-2bef26610026 req-d9eaec25-3db7-48d3-808a-cb503ab1b930 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6234ab8b-01a5-453b-92ee-2bef26610026 req-d9eaec25-3db7-48d3-808a-cb503ab1b930 service nova] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6234ab8b-01a5-453b-92ee-2bef26610026 req-d9eaec25-3db7-48d3-808a-cb503ab1b930 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-6234ab8b-01a5-453b-92ee-2bef26610026 req-d9eaec25-3db7-48d3-808a-cb503ab1b930 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:23 user nova-compute[75292]: DEBUG nova.compute.manager [req-6234ab8b-01a5-453b-92ee-2bef26610026 req-d9eaec25-3db7-48d3-808a-cb503ab1b930 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] No waiting events found dispatching network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:20:23 user nova-compute[75292]: WARNING nova.compute.manager [req-6234ab8b-01a5-453b-92ee-2bef26610026 req-d9eaec25-3db7-48d3-808a-cb503ab1b930 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received unexpected event network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 for instance with vm_state active and task_state None.
Nov 14 15:20:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:35 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:40 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:20:41 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:20:42 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:20:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:20:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:20:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:45 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:20:47 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:48 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:50 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:53 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:20:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:53 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:53 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:20:53 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:20:54 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=25.101078033447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:20:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:20:55 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:20:59 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:37 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:21:42 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:21:43 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:21:43 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:21:43 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:21:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:21:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:21:54 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:21:55 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:21:55 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.100521087646484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:21:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:21:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:22:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-changed-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:22:07 user nova-compute[75292]: DEBUG nova.compute.manager [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Refreshing instance network info cache due to event network-changed-b995b3cf-f8b1-431c-8030-549bb2808c46. {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 15:22:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:22:07 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:22:07 user nova-compute[75292]: DEBUG nova.network.neutron [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Refreshing network info cache for port b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 15:22:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated VIF entry in instance network info cache for port b995b3cf-f8b1-431c-8030-549bb2808c46. {{(pid=75292) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 15:22:08 user nova-compute[75292]: DEBUG nova.network.neutron [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:22:08 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-4b026651-3025-430d-87e6-b9516f19b8e1 req-40896fd5-6c74-4db0-a841-ae557f78478a service nova] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:22:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:22:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:22:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:22:09 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:22:09 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:22:10 user nova-compute[75292]: INFO nova.compute.manager [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attaching volume d56e48b9-4e7f-4823-8f7c-09247e052b06 to /dev/vdb
Nov 14 15:22:10 user nova-compute[75292]: DEBUG os_brick.utils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[06404faf-a141-4f47-ba3f-b9528dba4204]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff1455-f207-4ad7-a1c7-13e06798dee0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37706146-5be1-4242-9a86-89c446481bd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f070630-8ac1-472a-bf3f-4da500bc8de1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:22:10 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:22:10 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3984ba9f-c079-4e36-9f6e-2da28b4dd5ff]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG os_brick.utils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating existing volume attachment record: c33e3cfc-3356-4b2e-b9fb-15039ed40c21 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:22:10 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuLIsUyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:22:14 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:22:14 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:22:14 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb9c58-6f4b-4f27-9f15-1f03580715a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:22:14 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[465c8243-6368-4d5a-b85f-f63b401ec9ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06] added
Nov 14 15:22:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee329e3-5400-4816-8bc8-8beec59ee9bc]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cffdff-ab6b-42ae-93d0-27ecc6eb3b2f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuLIsUyp {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuLIsUyp" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[20690a9e-5fb2-4afc-85dd-91b9a03194ca]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuLIsUyp'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9887e3-de84-4d82-a88e-5155769b803e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1cb101-5c0f-4709-a7db-db4a3501c6c0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:22:14 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:22:14 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:22:14 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:22:14 user nova-compute[75292]: 
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e553c7-1b85-48a0-a882-578c5cff5288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260]
Nov 14 15:22:14 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260] successful.
Nov 14 15:22:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d4720-10d5-4f7d-92de-90bde1df2ef8]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3ebfba-77f5-49af-9fbb-080752ac2677]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 (non-flash)
Nov 14 15:22:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 (non-flash)
Nov 14 15:22:14 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5ac99-284e-4282-97fd-76ccff6a4613]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:22:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuLIsUyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23439613834346536', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439613834346536', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG nova.objects.instance [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:15 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:22:15 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:22:15 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:22:15 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:22:15 user nova-compute[75292]:   <serial>d56e48b9-4e7f-4823-8f7c-09247e052b06</serial>
Nov 14 15:22:15 user nova-compute[75292]: </disk>
Nov 14 15:22:15 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:22:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:22:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:22:16 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No VIF found with MAC fa:16:3e:cc:71:a1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:22:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-e62aea14-61b9-4d3c-92ab-226ac2e49bf9 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.067s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:22:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:22:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:22:23 user nova-compute[75292]: INFO nova.compute.manager [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Detaching volume d56e48b9-4e7f-4823-8f7c-09247e052b06
Nov 14 15:22:23 user nova-compute[75292]: INFO nova.virt.block_device [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attempting to driver detach volume d56e48b9-4e7f-4823-8f7c-09247e052b06 from mountpoint /dev/vdb
Nov 14 15:22:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Attempting to detach device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:22:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:22:23 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:22:23 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:22:23 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:22:23 user nova-compute[75292]:   <serial>d56e48b9-4e7f-4823-8f7c-09247e052b06</serial>
Nov 14 15:22:23 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:22:23 user nova-compute[75292]: </disk>
Nov 14 15:22:23 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:22:23 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config.
Nov 14 15:22:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:22:23 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:22:23 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:22:23 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:22:23 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:22:23 user nova-compute[75292]:   <serial>d56e48b9-4e7f-4823-8f7c-09247e052b06</serial>
Nov 14 15:22:23 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:22:23 user nova-compute[75292]: </disk>
Nov 14 15:22:23 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:22:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:22:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:22:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:22:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:22:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:22:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:39 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:40 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:44 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 is timed out.
Nov 14 15:22:44 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config.
Nov 14 15:22:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuLIsUyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:22:44 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbcfd6e-a45d-4b0b-b996-c30eb3f1b2df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:22:44 user nova-compute[75292]: No targets found.
Nov 14 15:22:44 user nova-compute[75292]: iSNS:
Nov 14 15:22:44 user nova-compute[75292]: No targets found.
Nov 14 15:22:44 user nova-compute[75292]: STATIC:
Nov 14 15:22:44 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06
Nov 14 15:22:44 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:22:44 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:22:44 user nova-compute[75292]: FIRMWARE:
Nov 14 15:22:44 user nova-compute[75292]: No targets found.
Nov 14 15:22:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:22:44 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:22:44 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6a159c-a884-47f0-8bea-028dae7cb542]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f466b4-ea74-4f60-84f9-69b8dc901b8a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 (non-flash)
Nov 14 15:22:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 (non-flash)
Nov 14 15:22:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b741440d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc3e6e0-7cac-4b60-90f8-d6987a01d090]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4904fbf-6ab9-46b9-90d0-7f538a832f44]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3e0884-80d3-4dab-8ffc-472af50673c1]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2897f8-79d9-406c-b129-00bafb9d3b0e]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb820ae-b9c4-4a7a-bcdf-499df5a5e719]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9723cbd1-2f5a-4357-8706-e7e27db7df62]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260]
Nov 14 15:22:44 user nova-compute[75292]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06, portal: 172.16.0.220,3260] successful.
Nov 14 15:22:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d56e48b9-4e7f-4823-8f7c-09247e052b06 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b352bc-36e2-4120-b539-484b32846006]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== disconnect_volume: return (294ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:22:44 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:22:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:22:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:22:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:22:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:22:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-bc654ca0-b858-4332-a120-bcaed76d7b07 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.709s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:22:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:22:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:22:51 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:22:55 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:22:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:22:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:22:55 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:22:55 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:22:55 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:22:56 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:22:56 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.099273681640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:22:56 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:22:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:23:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:03 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:23:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:23:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:23:15 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:23:15 user nova-compute[75292]: INFO nova.compute.manager [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attaching volume 7ec1a801-f334-41e3-9c7b-e9c2d64ee159 to /dev/vdb
Nov 14 15:23:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9716081-0a5e-4d55-baa1-71239345d281]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf3599c-a2bd-448b-8232-8933ba7880f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[142ac33b-0342-4a31-82ac-fac488b6b0d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5947271-8453-4dd4-82f6-b737295f96f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:23:16 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:23:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b25afd-e253-461f-95f2-de16f57895f4]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:23:16 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating existing volume attachment record: a35e4f32-6733-42de-95f9-13029d63f713 {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:23:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwnDmBaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:23:20 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:23:20 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:23:20 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[944709bc-c6db-4bd4-954f-ee0a735eda12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:23:20 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[df84cc87-76cf-4bd9-b6b4-339a885889da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159] added
Nov 14 15:23:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5349c950-3803-492c-b506-1bd8aae24f8b]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc9f77-2376-45ec-b914-380214f0d385]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwnDmBaA {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qwnDmBaA" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd3969f-9af5-4d75-bb27-43849bf08a22]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qwnDmBaA'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c4ce2b-93d8-438d-9645-86ae3da71b94]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db18b29-b0ee-41a4-92f3-3d08f37e1eff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:23:20 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:23:20 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:23:20 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:23:20 user nova-compute[75292]: 
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b81f4c-03cf-481c-897b-5004e71c4668]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260]
Nov 14 15:23:20 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260] successful.
Nov 14 15:23:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d139c6-e5f4-4409-8f47-4a6b848f8c4c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ebb8c-6a98-43c5-9f6e-4a6ac3da56c9]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 (non-flash)
Nov 14 15:23:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 (non-flash)
Nov 14 15:23:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7070f45c-ddd9-4e7a-b019-a1b7f90d7d8a]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:23:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwnDmBaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26265366165343836', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265366165343836', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG nova.objects.instance [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:23:21 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:23:21 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:23:21 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:23:21 user nova-compute[75292]:   <serial>7ec1a801-f334-41e3-9c7b-e9c2d64ee159</serial>
Nov 14 15:23:21 user nova-compute[75292]: </disk>
Nov 14 15:23:21 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:23:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No VIF found with MAC fa:16:3e:cc:71:a1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:23:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-0489e338-4ac2-42f7-bf6d-cb2531bba581 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.199s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:23:24 user nova-compute[75292]: INFO nova.compute.manager [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Detaching volume 7ec1a801-f334-41e3-9c7b-e9c2d64ee159
Nov 14 15:23:24 user nova-compute[75292]: INFO nova.virt.block_device [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attempting to driver detach volume 7ec1a801-f334-41e3-9c7b-e9c2d64ee159 from mountpoint /dev/vdb
Nov 14 15:23:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Attempting to detach device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:23:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:23:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:23:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:23:24 user nova-compute[75292]:   <serial>7ec1a801-f334-41e3-9c7b-e9c2d64ee159</serial>
Nov 14 15:23:24 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:23:24 user nova-compute[75292]: </disk>
Nov 14 15:23:24 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:23:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config.
Nov 14 15:23:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:23:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:23:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:23:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:23:24 user nova-compute[75292]:   <serial>7ec1a801-f334-41e3-9c7b-e9c2d64ee159</serial>
Nov 14 15:23:24 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:23:24 user nova-compute[75292]: </disk>
Nov 14 15:23:24 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:23:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:23:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:39 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:44 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 is timed out.
Nov 14 15:23:44 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config.
Nov 14 15:23:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qwnDmBaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:23:44 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea26ecf6-cd2c-4cd1-8763-2e8cc9955abc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:23:44 user nova-compute[75292]: No targets found.
Nov 14 15:23:44 user nova-compute[75292]: iSNS:
Nov 14 15:23:44 user nova-compute[75292]: No targets found.
Nov 14 15:23:44 user nova-compute[75292]: STATIC:
Nov 14 15:23:44 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159
Nov 14 15:23:44 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:23:44 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:23:44 user nova-compute[75292]: FIRMWARE:
Nov 14 15:23:44 user nova-compute[75292]: No targets found.
Nov 14 15:23:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:23:44 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:23:44 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1209e3ae-7a93-4e80-9b2a-3be50bc0a3f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1bc44-3c5b-43a6-97b0-ebf2d76ee782]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 (non-flash)
Nov 14 15:23:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 (non-flash)
Nov 14 15:23:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b54198280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bbb000-2d36-4d0b-9f67-c1f18d41ffab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[24480780-9b53-4722-9066-5ad2732337d6]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2fec3-9ebc-4d8d-8c77-6a590a5b51a3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc32b78-ee89-44a0-833a-4a845bb866a6]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979b39f-9df1-466d-b208-ecd7c06c8d87]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b665e8b2-5e4b-4fa6-942b-a953dd13c453]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260]
Nov 14 15:23:44 user nova-compute[75292]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159, portal: 172.16.0.220,3260] successful.
Nov 14 15:23:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ec1a801-f334-41e3-9c7b-e9c2d64ee159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb48f6-42cc-4c8b-a3aa-3a8ff10af83a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== disconnect_volume: return (312ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:23:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-7c08b4b3-d0b8-4b0d-a75f-c20a38d567dc tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:23:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:23:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:52 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:23:55 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:57 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:23:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:23:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:23:57 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:23:57 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:23:57 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:23:58 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:23:58 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=25.098262786865234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:23:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:23:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:04 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:05 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:15 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:24:16 user nova-compute[75292]: INFO nova.compute.manager [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attaching volume 194a59e4-0e15-446c-8a98-4ae2d2b5a39b to /dev/vdb
Nov 14 15:24:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e37ffd9-44f6-4bf1-b217-1f6628850ae7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[9335c01b-491a-4312-8431-1c31d0bc9bec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f9345-42d2-4b71-b25e-74260e3433f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa32757-b66c-43f1-9c24-0d3bc135bbe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:24:16 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:24:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[89daebb5-a860-4a47-a845-987aea8e45bb]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:24:16 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating existing volume attachment record: 57f4dbf6-d15e-4872-b979-8bff268d86ab {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:24:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tljHqdCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:24:20 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:24:20 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:24:20 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae893db-f5eb-4e34-a66d-1c95e571efde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:24:20 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[293dcaa4-1a26-43e0-8cbd-d9533db6ab1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b] added
Nov 14 15:24:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de14cf4-39b1-4306-a466-35d51e13d95a]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8d487-dd32-4d4a-8631-f6a3b670cb8f]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tljHqdCp {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tljHqdCp" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6fd720-357a-4b97-b6ad-e1720d76d1e5]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tljHqdCp'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed84973-c693-4479-b264-e6e839399d21]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7582b7-6c41-4c30-8b99-414b54274736]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:24:20 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:24:20 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:24:20 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:24:20 user nova-compute[75292]: 
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[17af584f-3dfa-484c-be35-e7fa514e5e9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260]
Nov 14 15:24:20 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260] successful.
Nov 14 15:24:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1028799a-629c-49b1-a421-1668a3484ab3]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed6ef6f-a4c0-4b3b-b26d-a651ef811e85]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b (non-flash)
Nov 14 15:24:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b (non-flash)
Nov 14 15:24:20 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed73b6a-ac27-4dfe-ac7c-25555f6a6985]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:20 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tljHqdCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '23463346232623539', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463346232623539', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG nova.objects.instance [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:24:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:24:21 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:24:21 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:24:21 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:24:21 user nova-compute[75292]:   <serial>194a59e4-0e15-446c-8a98-4ae2d2b5a39b</serial>
Nov 14 15:24:21 user nova-compute[75292]: </disk>
Nov 14 15:24:21 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:24:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:24:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:24:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No VIF found with MAC fa:16:3e:cc:71:a1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:24:22 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-d9e4f986-d0cf-4c55-88f5-0c364269a04c tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.116s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:24:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:24:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:24:24 user nova-compute[75292]: INFO nova.compute.manager [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Detaching volume 194a59e4-0e15-446c-8a98-4ae2d2b5a39b
Nov 14 15:24:24 user nova-compute[75292]: INFO nova.virt.block_device [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attempting to driver detach volume 194a59e4-0e15-446c-8a98-4ae2d2b5a39b from mountpoint /dev/vdb
Nov 14 15:24:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Attempting to detach device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:24:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:24:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:24:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:24:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:24:24 user nova-compute[75292]:   <serial>194a59e4-0e15-446c-8a98-4ae2d2b5a39b</serial>
Nov 14 15:24:24 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:24:24 user nova-compute[75292]: </disk>
Nov 14 15:24:24 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:24:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config.
Nov 14 15:24:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:24:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:24:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:24:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:24:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:24:24 user nova-compute[75292]:   <serial>194a59e4-0e15-446c-8a98-4ae2d2b5a39b</serial>
Nov 14 15:24:24 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:24:24 user nova-compute[75292]: </disk>
Nov 14 15:24:24 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:24:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:24:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:24:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:24:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:24:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:41 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:44 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 is timed out.
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:44 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config.
Nov 14 15:24:44 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tljHqdCp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:24:44 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cabe8d-050e-43e5-bd92-6a976b2f70d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:24:44 user nova-compute[75292]: No targets found.
Nov 14 15:24:44 user nova-compute[75292]: iSNS:
Nov 14 15:24:44 user nova-compute[75292]: No targets found.
Nov 14 15:24:44 user nova-compute[75292]: STATIC:
Nov 14 15:24:44 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b
Nov 14 15:24:44 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:24:44 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:24:44 user nova-compute[75292]: FIRMWARE:
Nov 14 15:24:44 user nova-compute[75292]: No targets found.
Nov 14 15:24:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:24:44 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:24:44 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1cfcb8-c4ca-4461-bad9-ccd28c6110e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[662973b8-1eb6-43c0-bf85-c08629a6f4e9]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b (non-flash)
Nov 14 15:24:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b (non-flash)
Nov 14 15:24:44 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b30638670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e853777-0fd4-4c14-a3b1-eb4885e2dc6f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:44 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab0ebb7-3636-4256-be34-a8156319d355]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[35452b2e-dc54-4776-8ca6-d9715dfafe1d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e875e0f-6652-489b-8567-8cf0e26dccb0]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764ac8a-f4ef-45c1-8541-a6fac4814544]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9452cc5-4ba1-4ac3-b48a-b7f43b13f16f]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260]
Nov 14 15:24:45 user nova-compute[75292]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b, portal: 172.16.0.220,3260] successful.
Nov 14 15:24:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:194a59e4-0e15-446c-8a98-4ae2d2b5a39b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a5e2db-d1ae-4184-b0d7-973bf54b2acf]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== disconnect_volume: return (311ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:24:45 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-899cd923-2df0-4b94-be49-a8303d945db3 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:24:46 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:24:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:24:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:24:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75292) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 15:24:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:49 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:24:53 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:24:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:24:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:24:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:24:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:24:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:24:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:24:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:24:58 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:24:58 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:24:58 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:24:59 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:24:59 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:24:59 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:24:59 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.09729766845703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:24:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:24:59 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:24:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing inventories for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating ProviderTree inventory for provider 09e514fa-427e-42ca-8897-f1a398f916a9 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Updating inventory in ProviderTree for provider 09e514fa-427e-42ca-8897-f1a398f916a9 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing aggregate associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, aggregates: None {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Refreshing trait associations for resource provider 09e514fa-427e-42ca-8897-f1a398f916a9, traits: HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ACCELERATORS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC {{(pid=75292) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:25:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:25:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:25:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:11 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Cleaning up deleted instances {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 15:25:11 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] There are 0 instances to clean {{(pid=75292) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 15:25:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:25:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:25:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:25:16 user nova-compute[75292]: INFO nova.compute.manager [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attaching volume bf4250f4-bec9-4051-a24e-a0ed95a4db38 to /dev/vdb
Nov 14 15:25:16 user nova-compute[75292]: DEBUG os_brick.utils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aae69bf-40d8-4188-9a14-200467a5ecad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4a3e617bf68a\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:16 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[33008931-4c83-499a-913b-4597cb5368aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[71490bf6-822f-4223-9a20-bed98de23e36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7e1987-2b07-4fa5-b0db-e9d519f370da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Running cmd (subprocess): nvme version {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] 'nvme version' failed. Not Retrying. {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] nvme not present on system {{(pid=75292) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 15:25:17 user nova-compute[75292]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 15:25:17 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339ad37-8455-4b03-a594-e4c508113285]: (4, '') {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75292) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.lightos [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] LIGHTOS: no hostnqn found. {{(pid=75292) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG os_brick.utils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4a3e617bf68a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:25:17 user nova-compute[75292]: DEBUG nova.virt.block_device [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating existing volume attachment record: cb99b161-f7ea-4026-bef5-2885b9ba54fd {{(pid=75292) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 15:25:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:20 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Calling os-brick to attach iSCSI Volume {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBIvusPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:25:21 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:25:21 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:25:21 user nova-compute[75292]: INFO os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ef2c8-58fb-4c94-ae55-369c4dc5f016]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 15:25:21 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[671c95f9-07f3-4cc9-b2ce-058ccce9e97b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38] added\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38] added
Nov 14 15:25:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6a404a-39ee-418f-b0b4-fadcab3db05e]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efcaff9-993b-4edd-96c0-a7b0c1f257cd]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBIvusPZ {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBIvusPZ" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e52d6b-9703-47dc-aa28-833d47df8538]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oBIvusPZ'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba772497-e506-427c-96ee-5221f2245986]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad92d35-fa72-4384-b10a-10345e054282]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:25:21 user nova-compute[75292]:  {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 15:25:21 user nova-compute[75292]:  {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:25:21 user nova-compute[75292]: WARNING os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 15:25:21 user nova-compute[75292]: 
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --login {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee5980-0f94-476b-a281-e70fc4f4b063]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260]
Nov 14 15:25:21 user nova-compute[75292]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260] successful.
Nov 14 15:25:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6535f-2f80-449b-b722-212226d09e3d]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eed0a0-7cba-447b-aaba-0ff63f3c4349]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 (non-flash)
Nov 14 15:25:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 (non-flash)
Nov 14 15:25:21 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to 172.16.0.220:3260 {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75292) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75292) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[c356ef9f-ca72-478f-8e2e-7881d6f44d6c]: (4, ('- - 0', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:21 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75292) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBIvusPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75292) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '26366336161303839', 'path': '/dev/sdb'} {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366336161303839', 'path': '/dev/sdb'} {{(pid=75292) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG nova.objects.instance [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 15:25:22 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:25:22 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:25:22 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:25:22 user nova-compute[75292]:   <serial>bf4250f4-bec9-4051-a24e-a0ed95a4db38</serial>
Nov 14 15:25:22 user nova-compute[75292]: </disk>
Nov 14 15:25:22 user nova-compute[75292]:  {{(pid=75292) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75292) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 15:25:22 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] No VIF found with MAC fa:16:3e:cc:71:a1, not building metadata {{(pid=75292) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 15:25:23 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-f8506a84-3ee5-4421-bceb-810ec0b611c7 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.199s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:25:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:25:24 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:25:24 user nova-compute[75292]: INFO nova.compute.manager [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Detaching volume bf4250f4-bec9-4051-a24e-a0ed95a4db38
Nov 14 15:25:24 user nova-compute[75292]: INFO nova.virt.block_device [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Attempting to driver detach volume bf4250f4-bec9-4051-a24e-a0ed95a4db38 from mountpoint /dev/vdb
Nov 14 15:25:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Attempting to detach device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config. {{(pid=75292) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 15:25:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:25:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:25:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:25:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:25:24 user nova-compute[75292]:   <serial>bf4250f4-bec9-4051-a24e-a0ed95a4db38</serial>
Nov 14 15:25:24 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:25:24 user nova-compute[75292]: </disk>
Nov 14 15:25:24 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:25:24 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the persistent domain config.
Nov 14 15:25:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config. {{(pid=75292) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 15:25:24 user nova-compute[75292]: DEBUG nova.virt.libvirt.guest [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 15:25:24 user nova-compute[75292]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 15:25:24 user nova-compute[75292]:   <source dev="/dev/sdb"/>
Nov 14 15:25:24 user nova-compute[75292]:   <target dev="vdb" bus="virtio"/>
Nov 14 15:25:24 user nova-compute[75292]:   <serial>bf4250f4-bec9-4051-a24e-a0ed95a4db38</serial>
Nov 14 15:25:24 user nova-compute[75292]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 15:25:24 user nova-compute[75292]: </disk>
Nov 14 15:25:24 user nova-compute[75292]:  {{(pid=75292) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 15:25:25 user nova-compute[75292]: DEBUG nova.virt.libvirt.driver [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 15:25:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:29 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:25:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:25:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:34 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:39 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:43 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:45 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 is timed out.
Nov 14 15:25:45 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully detached device vdb from instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 from the live domain config.
Nov 14 15:25:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] calling os-brick to detach iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b545025f0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBIvusPZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 15:25:45 user nova-compute[75292]: WARNING os_brick.initiator.connectors.base [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea46ed9-0770-4e87-aeb9-2dcd75f84b78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 15:25:45 user nova-compute[75292]: No targets found.
Nov 14 15:25:45 user nova-compute[75292]: iSNS:
Nov 14 15:25:45 user nova-compute[75292]: No targets found.
Nov 14 15:25:45 user nova-compute[75292]: STATIC:
Nov 14 15:25:45 user nova-compute[75292]: Target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38
Nov 14 15:25:45 user nova-compute[75292]:         Portal: 172.16.0.220:3260,-1
Nov 14 15:25:45 user nova-compute[75292]:                 Iface Name: default
Nov 14 15:25:45 user nova-compute[75292]: FIRMWARE:
Nov 14 15:25:45 user nova-compute[75292]: No targets found.
Nov 14 15:25:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 15:25:45 user nova-compute[75292]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 15:25:45 user nova-compute[75292]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75292) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38', 0)] {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea076f5-acfd-4106-8751-4937dab63ce6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a665de0-0b40-4ab5-9f98-941811abde55]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 (non-flash)\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 (non-flash)
Nov 14 15:25:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 (non-flash)
Nov 14 15:25:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6c1a31c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38'): ({'sdb'}, set())}) {{(pid=75292) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Removing single pathed devices sdb {{(pid=75292) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446beaa-5bfc-4074-aa5f-0b6e56f83219]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[db84b76d-7f0d-4bf5-8934-b3472ccfb515]: (4, ('ok\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Flushing IO for device /dev/sdb {{(pid=75292) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf70c78a-b19c-4531-b9de-354767d0f19c]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75292) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac5cd97-c13a-450a-aa6d-95bca531f3f8]: (4, ('1', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.linuxscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] SCSI volumes sdb have been removed. {{(pid=75292) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38')] {{(pid=75292) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29de671-efd1-42f8-a01a-4663a8e17221]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --logout {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cb8e63-c476-42ea-9a31-7ff07f7c1aa4]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260]
Nov 14 15:25:45 user nova-compute[75292]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38, portal: 172.16.0.220,3260] successful.
Nov 14 15:25:45 user nova-compute[75292]:  stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op delete {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf4250f4-bec9-4051-a24e-a0ed95a4db38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86373) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c29928-e2c7-4b2b-9b00-723563ad4411]: (4, ('', '')) {{(pid=86373) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75292) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.base [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG os_brick.initiator.connectors.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] <== disconnect_volume: return (287ms) None {{(pid=75292) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 15:25:45 user nova-compute[75292]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Disconnected iSCSI Volume {{(pid=75292) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 15:25:46 user nova-compute[75292]: DEBUG nova.objects.instance [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'flavor' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:25:46 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-371c9b8d-5d4c-45e2-912e-173c8d06a99a tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.569s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:25:46 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:25:46 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquired lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Forcefully refreshing network info cache for instance {{(pid=75292) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG nova.objects.instance [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lazy-loading 'info_cache' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG nova.network.neutron [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [{"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Releasing lock "refresh_cache-cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" {{(pid=75292) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 15:25:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updated the network info_cache for instance {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 15:25:48 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:49 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:49 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:49 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:25:54 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:25:54 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:58 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:25:59 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:00 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:00 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:00 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:26:00 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG oslo_concurrency.processutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75292) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 15:26:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:26:01 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=25.096336364746094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75292) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:26:01 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:04 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:06 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:09 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:14 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:24 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:27 user nova-compute[75292]: INFO nova.compute.manager [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Terminating instance
Nov 14 15:26:27 user nova-compute[75292]: DEBUG nova.compute.manager [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Start destroying the instance on the hypervisor. {{(pid=75292) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:27 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-9d4c6e85-7dd6-46f4-ad6b-6a672c95f884 req-d492663d-b9b3-46f1-aeaf-bfef685b4166 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-vif-unplugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9d4c6e85-7dd6-46f4-ad6b-6a672c95f884 req-d492663d-b9b3-46f1-aeaf-bfef685b4166 service nova] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9d4c6e85-7dd6-46f4-ad6b-6a672c95f884 req-d492663d-b9b3-46f1-aeaf-bfef685b4166 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-9d4c6e85-7dd6-46f4-ad6b-6a672c95f884 req-d492663d-b9b3-46f1-aeaf-bfef685b4166 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-9d4c6e85-7dd6-46f4-ad6b-6a672c95f884 req-d492663d-b9b3-46f1-aeaf-bfef685b4166 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] No waiting events found dispatching network-vif-unplugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.compute.manager [req-9d4c6e85-7dd6-46f4-ad6b-6a672c95f884 req-d492663d-b9b3-46f1-aeaf-bfef685b4166 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-vif-unplugged-b995b3cf-f8b1-431c-8030-549bb2808c46 for instance with task_state deleting. {{(pid=75292) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 15:26:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [-] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Instance destroyed successfully.
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.objects.instance [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lazy-loading 'resources' on Instance uuid cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1 {{(pid=75292) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.virt.libvirt.vif [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T15:20:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1452767995',display_name='tempest-SnapshotDataIntegrityTests-server-1452767995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1452767995',id=53,image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwkIDgaX6S6Yus6tqbCRIZ9PgcfIbobhShXYQYfWXyXalEy3Md3S9RRXYjVJq3RqkeZELqSSJx4jDpuwq5zw2IV6G/1H8sWQCkv/ze4LkoflWfE/1Who7h1eXXwBz00gA==',key_name='tempest-keypair-391824685',keypairs=<?>,launch_index=0,launched_at=2023-11-14T15:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7719e42290482db2d36bfd5083dbe2',ramdisk_id='',reservation_id='r-jc83x3fb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf213fca-dee8-42b3-bde7-bb229ab5915b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-126930450',owner_user_name='tempest-SnapshotDataIntegrityTests-126930450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T15:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='133ae7119b244ca39b451f776fd82545',uuid=cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Converting VIF {"id": "b995b3cf-f8b1-431c-8030-549bb2808c46", "address": "fa:16:3e:cc:71:a1", "network": {"id": "f67db7b7-f2a4-4559-8f67-af52a6af0fcc", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1779192168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7719e42290482db2d36bfd5083dbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb995b3cf-f8", "ovs_interfaceid": "b995b3cf-f8b1-431c-8030-549bb2808c46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.network.os_vif_util [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8') {{(pid=75292) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG os_vif [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8') {{(pid=75292) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb995b3cf-f8, bridge=br-int, if_exists=True) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe82548a-e591-4920-a302-01eb0bc254e9) {{(pid=75292) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: INFO os_vif [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:71:a1,bridge_name='br-int',has_traffic_filtering=True,id=b995b3cf-f8b1-431c-8030-549bb2808c46,network=Network(f67db7b7-f2a4-4559-8f67-af52a6af0fcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb995b3cf-f8')
Nov 14 15:26:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Deleting instance files /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1_del
Nov 14 15:26:28 user nova-compute[75292]: INFO nova.virt.libvirt.driver [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Deletion of /opt/stack/data/nova/instances/cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1_del complete
Nov 14 15:26:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:28 user nova-compute[75292]: INFO nova.compute.manager [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 14 15:26:28 user nova-compute[75292]: DEBUG oslo.service.loopingcall [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75292) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.compute.manager [-] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Deallocating network for instance {{(pid=75292) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 15:26:28 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] deallocate_for_instance() {{(pid=75292) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 15:26:29 user nova-compute[75292]: DEBUG nova.network.neutron [-] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Updating instance_info_cache with network_info: [] {{(pid=75292) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 15:26:29 user nova-compute[75292]: INFO nova.compute.manager [-] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Took 0.81 seconds to deallocate network for instance.
Nov 14 15:26:29 user nova-compute[75292]: DEBUG nova.compute.manager [req-ab37aa76-7b05-43e3-8c6e-403cb2f6ae9c req-83db5983-994a-4a95-a671-2868c75b2f1b service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-vif-deleted-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:26:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:29 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:26:29 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:26:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:29 user nova-compute[75292]: INFO nova.scheduler.client.report [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Deleted allocations for instance cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1
Nov 14 15:26:29 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-8adeaaaf-655b-4580-aac3-31bc9c3e0342 tempest-SnapshotDataIntegrityTests-126930450 tempest-SnapshotDataIntegrityTests-126930450-project-member] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.122s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-e33f1d0e-3d63-48a5-b8c5-d53faa421667 req-b1840b49-0651-404a-8516-9e9f9d098a26 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received event network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 15:26:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e33f1d0e-3d63-48a5-b8c5-d53faa421667 req-b1840b49-0651-404a-8516-9e9f9d098a26 service nova] Acquiring lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:26:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e33f1d0e-3d63-48a5-b8c5-d53faa421667 req-b1840b49-0651-404a-8516-9e9f9d098a26 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:26:30 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [req-e33f1d0e-3d63-48a5-b8c5-d53faa421667 req-b1840b49-0651-404a-8516-9e9f9d098a26 service nova] Lock "cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:26:30 user nova-compute[75292]: DEBUG nova.compute.manager [req-e33f1d0e-3d63-48a5-b8c5-d53faa421667 req-b1840b49-0651-404a-8516-9e9f9d098a26 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] No waiting events found dispatching network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 {{(pid=75292) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 15:26:30 user nova-compute[75292]: WARNING nova.compute.manager [req-e33f1d0e-3d63-48a5-b8c5-d53faa421667 req-b1840b49-0651-404a-8516-9e9f9d098a26 service nova] [instance: cd5618da-17d3-4a2b-b3c8-cc16dcb15fa1] Received unexpected event network-vif-plugged-b995b3cf-f8b1-431c-8030-549bb2808c46 for instance with vm_state deleted and task_state None.
Nov 14 15:26:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:44 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:26:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:26:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 15:26:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:26:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75292) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 15:26:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:26:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75292) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 15:26:48 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:49 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:50 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:50 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75292) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 15:26:53 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:26:54 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:26:58 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:27:02 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:27:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:27:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:27:02 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:27:02 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75292) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 15:27:03 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:27:03 user nova-compute[75292]: WARNING nova.virt.libvirt.driver [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 15:27:03 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Hypervisor/Node resource view: name=user free_ram=9103MB free_disk=25.123493194580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75292) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75292) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG nova.compute.provider_tree [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed in ProviderTree for provider: 09e514fa-427e-42ca-8897-f1a398f916a9 {{(pid=75292) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG nova.scheduler.client.report [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Inventory has not changed for provider 09e514fa-427e-42ca-8897-f1a398f916a9 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75292) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG nova.compute.resource_tracker [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Compute_service record updated for user:user {{(pid=75292) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG oslo_concurrency.lockutils [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75292) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 15:27:03 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:27:07 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:27:08 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:08 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:27:13 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:27:18 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:19 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:22 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:23 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:25 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:28 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:33 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:38 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 15:27:43 user nova-compute[75292]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75292) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 15:27:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:27:45 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:27:47 user nova-compute[75292]: DEBUG oslo_service.periodic_task [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75292) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 15:27:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Starting heal instance info cache {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 15:27:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Rebuilding the list of instances to heal {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 15:27:47 user nova-compute[75292]: DEBUG nova.compute.manager [None req-53dec783-9ca3-4a82-bafb-c9f3b02ca9b0 None None] Didn't find any instances for network info cache update. {{(pid=75292) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}